org.apache.spark.streaming.dstream

Class QueueInputDStream<T>

Object

org.apache.spark.streaming.dstream.DStream<T>

org.apache.spark.streaming.dstream.InputDStream<T>

org.apache.spark.streaming.dstream.QueueInputDStream<T>

All Implemented Interfaces:

java.io.Serializable, Logging

public class QueueInputDStream<T>
extends InputDStream<T>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
QueueInputDStream(StreamingContext ssc, scala.collection.mutable.Queue<RDD<T>> queue, boolean oneAtATime, RDD<T> defaultRDD, scala.reflect.ClassTag<T> evidence$1)

Method Summary

Methods

Modifier and Type	Method and Description
scala.Option<RDD<T>>	compute(Time validTime) Method that generates a RDD for the given time
scala.collection.mutable.Queue<RDD<T>>	queue()
void	start() Method called to start receiving data.
void	stop() Method called to stop receiving data.

Methods inherited from class org.apache.spark.streaming.dstream.InputDStream

dependencies, isTimeValid, lastValidTime, slideDuration

Methods inherited from class org.apache.spark.streaming.dstream.DStream

cache, checkpoint, checkpointData, checkpointDuration, clearCheckpointData, clearMetadata, context, count, countByValue, countByValueAndWindow, countByWindow, creationSite, filter, flatMap, foreach, foreach, foreachRDD, foreachRDD, generatedRDDs, generateJob, getCreationSite, getOrCompute, glom, graph, initialize, isInitialized, map, mapPartitions, mustCheckpoint, parentRememberDuration, persist, persist, print, reduce, reduceByWindow, reduceByWindow, register, remember, rememberDuration, repartition, restoreCheckpointData, saveAsObjectFiles, saveAsTextFiles, setContext, setGraph, slice, slice, ssc, storageLevel, transform, transform, transformWith, transformWith, union, updateCheckpointData, validate, window, window, zeroTime

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

QueueInputDStream

public QueueInputDStream(StreamingContext ssc,
                 scala.collection.mutable.Queue<RDD<T>> queue,
                 boolean oneAtATime,
                 RDD<T> defaultRDD,
                 scala.reflect.ClassTag<T> evidence$1)

Method Detail

queue

public scala.collection.mutable.Queue<RDD<T>> queue()

start

public void start()

Description copied from class: InputDStream

Method called to start receiving data. Subclasses must implement this method.

Specified by:

start in class InputDStream<T>

stop

public void stop()

Description copied from class: InputDStream

Method called to stop receiving data. Subclasses must implement this method.

Specified by:

stop in class InputDStream<T>

compute

public scala.Option<RDD<T>> compute(Time validTime)

Description copied from class: DStream

Method that generates a RDD for the given time

Specified by:

compute in class DStream<T>