org.apache.flink.streaming.runtime.operators.sink

类 GlobalStreamingCommitterHandler<CommT,GlobalCommT>

java.lang.Object

org.apache.flink.streaming.runtime.operators.sink.GlobalStreamingCommitterHandler<CommT,GlobalCommT>

类型参数:

CommT - The committable type of the GlobalCommitter.

GlobalCommT - The global committable type of the GlobalCommitter.

@Internal
public final class GlobalStreamingCommitterHandler<CommT,GlobalCommT>
extends Object

CommitterHandler for executing GlobalCommitter in the streaming execution mode.

另请参阅:

序列化表格

构造器概要

构造器

构造器和说明
GlobalStreamingCommitterHandler(org.apache.flink.api.connector.sink.GlobalCommitter<CommT,GlobalCommT> globalCommitter, org.apache.flink.core.io.SimpleVersionedSerializer<GlobalCommT> committableSerializer)

方法概要

限定符和类型	方法和说明
void	close()
protected List<CommT>	commitUpTo(long checkpointId)
List<GlobalCommT>	endOfInput()
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
boolean	needsRetry()
Collection<GlobalCommT>	notifyCheckpointCompleted(long checkpointId)
protected List<InputT>	pollCommittables()
protected List<RecoverT>	prependRecoveredCommittables(List<RecoverT> committables)
List<OutputT>	processCommittables(List<InputT> committables) Processes the committables by either directly transforming them or by adding them to the internal state of this handler.
protected void	recoveredCommittables(List<GlobalCommT> committables) Notifies a list of committables that might need to be committed again after recovering from a failover.
void	retry() Retries all recovered committables.
protected void	retry(List<CommT> recoveredCommittables)
void	snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

GlobalStreamingCommitterHandler

public GlobalStreamingCommitterHandler(org.apache.flink.api.connector.sink.GlobalCommitter<CommT,GlobalCommT> globalCommitter,
                                       org.apache.flink.core.io.SimpleVersionedSerializer<GlobalCommT> committableSerializer)

方法详细资料

recoveredCommittables

protected void recoveredCommittables(List<GlobalCommT> committables)
                              throws IOException

Notifies a list of committables that might need to be committed again after recovering from a failover.

参数:

committables - A list of committables

抛出:

IOException

endOfInput

public List<GlobalCommT> endOfInput()

close

public void close()
           throws Exception

抛出:

Exception

notifyCheckpointCompleted

public Collection<GlobalCommT> notifyCheckpointCompleted(long checkpointId)
                                                  throws IOException,
                                                         InterruptedException

抛出:

IOException

InterruptedException

retry

protected void retry(List<CommT> recoveredCommittables)
              throws IOException,
                     InterruptedException

抛出:

IOException

InterruptedException

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

抛出:

Exception

snapshotState

public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
                   throws Exception

抛出:

Exception

commitUpTo

protected List<CommT> commitUpTo(long checkpointId)
                          throws IOException,
                                 InterruptedException

抛出:

IOException

InterruptedException

prependRecoveredCommittables

protected List<RecoverT> prependRecoveredCommittables(List<RecoverT> committables)

needsRetry

public boolean needsRetry()

retry

public void retry()
           throws IOException,
                  InterruptedException

Retries all recovered committables. These committables may either be restored in initializeState(StateInitializationContext) and have been re-added in any of the committing functions.

抛出:

IOException

InterruptedException

processCommittables

public List<OutputT> processCommittables(List<InputT> committables)

Processes the committables by either directly transforming them or by adding them to the internal state of this handler.

返回:

a list of output committables that is send downstream.

pollCommittables

protected List<InputT> pollCommittables()