org.apache.spark.streaming.scheduler

Class BatchInfo

Object

org.apache.spark.streaming.scheduler.BatchInfo

All Implemented Interfaces:

java.io.Serializable, scala.Equals, scala.Product

public class BatchInfo
extends Object
implements scala.Product, scala.Serializable

:: DeveloperApi :: Class having information on completed batches. param: batchTime Time of the batch param: streamIdToInputInfo A map of input stream id to its input info param: submissionTime Clock time of when jobs of this batch was submitted to the streaming scheduler queue param: processingStartTime Clock time of when the first job of this batch started processing param: processingEndTime Clock time of when the last job of this batch finished processing param: outputOperationInfos The output operations in this batch

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BatchInfo(Time batchTime, scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo, long submissionTime, scala.Option<Object> processingStartTime, scala.Option<Object> processingEndTime, scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos)

Method Summary

Modifier and Type	Method and Description
Time	batchTime()
abstract static boolean	canEqual(Object that)
abstract static boolean	equals(Object that)
long	numRecords() The number of recorders received by the receivers in this batch.
scala.collection.immutable.Map<Object,OutputOperationInfo>	outputOperationInfos()
scala.Option<Object>	processingDelay() Time taken for the all jobs of this batch to finish processing from the time they started processing.
scala.Option<Object>	processingEndTime()
scala.Option<Object>	processingStartTime()
abstract static int	productArity()
abstract static Object	productElement(int n)
static scala.collection.Iterator<Object>	productIterator()
static String	productPrefix()
scala.Option<Object>	schedulingDelay() Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler.
scala.collection.immutable.Map<Object,StreamInputInfo>	streamIdToInputInfo()
long	submissionTime()
scala.Option<Object>	totalDelay() Time taken for all the jobs of this batch to finish processing from the time they were submitted.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

BatchInfo

public BatchInfo(Time batchTime,
                 scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo,
                 long submissionTime,
                 scala.Option<Object> processingStartTime,
                 scala.Option<Object> processingEndTime,
                 scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos)

Method Detail

canEqual

public abstract static boolean canEqual(Object that)

equals

public abstract static boolean equals(Object that)

productElement

public abstract static Object productElement(int n)

productArity

public abstract static int productArity()

productIterator

public static scala.collection.Iterator<Object> productIterator()

productPrefix

public static String productPrefix()

batchTime

public Time batchTime()

streamIdToInputInfo

public scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo()

submissionTime

public long submissionTime()

processingStartTime

public scala.Option<Object> processingStartTime()

processingEndTime

public scala.Option<Object> processingEndTime()

outputOperationInfos

public scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos()

schedulingDelay

public scala.Option<Object> schedulingDelay()

Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler. Essentially, it is processingStartTime - submissionTime.

Returns:

(undocumented)

processingDelay

public scala.Option<Object> processingDelay()

Time taken for the all jobs of this batch to finish processing from the time they started processing. Essentially, it is processingEndTime - processingStartTime.

Returns:

(undocumented)

totalDelay

public scala.Option<Object> totalDelay()

Time taken for all the jobs of this batch to finish processing from the time they were submitted. Essentially, it is processingDelay + schedulingDelay.

Returns:

(undocumented)

numRecords

public long numRecords()

The number of recorders received by the receivers in this batch.

Returns:

(undocumented)