org.apache.spark.streaming.util

Class WriteAheadLogReader

Object

org.apache.spark.streaming.util.WriteAheadLogReader

All Implemented Interfaces:

java.io.Closeable, AutoCloseable, Logging, scala.collection.GenTraversableOnce<java.nio.ByteBuffer>, scala.collection.Iterator<java.nio.ByteBuffer>, scala.collection.TraversableOnce<java.nio.ByteBuffer>

public class WriteAheadLogReader
extends Object
implements scala.collection.Iterator<java.nio.ByteBuffer>, java.io.Closeable, Logging

A reader for reading write ahead log files written using WriteAheadLogWriter. This reads the records (bytebuffers) in the log file sequentially and return them as an iterator of bytebuffers.

Nested Class Summary

Nested classes/interfaces inherited from interface scala.collection.Iterator

scala.collection.Iterator.GroupedIterator<B>

Nested classes/interfaces inherited from interface scala.collection.TraversableOnce

scala.collection.TraversableOnce.BufferedCanBuildFrom<A,Coll extends scala.collection.TraversableOnce<Object>>, scala.collection.TraversableOnce.FlattenOps<A>, scala.collection.TraversableOnce.ForceImplicitAmbiguity, scala.collection.TraversableOnce.MonadOps<A>, scala.collection.TraversableOnce.OnceCanBuildFrom<A>

Constructor Summary

Constructors

Constructor and Description
WriteAheadLogReader(String path, org.apache.hadoop.conf.Configuration conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
boolean	hasNext()
java.nio.ByteBuffer	next()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.collection.Iterator

$plus$plus, buffered, collect, contains, copyToArray, corresponds, drop, dropWhile, duplicate, exists, filter, filterNot, find, flatMap, forall, foreach, grouped, hasDefiniteSize, indexOf, indexWhere, isEmpty, isTraversableAgain, length, map, padTo, partition, patch, sameElements, scanLeft, scanRight, seq, slice, sliding, sliding$default$2, span, take, takeWhile, toIterator, toStream, toString, toTraversable, withFilter, zip, zipAll, zipWithIndex

Methods inherited from interface scala.collection.TraversableOnce

$colon$bslash, $div$colon, addString, addString, addString, aggregate, collectFirst, copyToArray, copyToArray, copyToBuffer, count, fold, foldLeft, foldRight, max, maxBy, min, minBy, mkString, mkString, mkString, nonEmpty, product, reduce, reduceLeft, reduceLeftOption, reduceOption, reduceRight, reduceRightOption, reversed, size, sum, to, toArray, toBuffer, toIndexedSeq, toIterable, toList, toMap, toSeq, toSet, toVector

Methods inherited from interface scala.collection.GenTraversableOnce

$div$colon$bslash

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

WriteAheadLogReader

public WriteAheadLogReader(String path,
                   org.apache.hadoop.conf.Configuration conf)

Method Detail

hasNext

public boolean hasNext()

Specified by:

hasNext in interface scala.collection.Iterator<java.nio.ByteBuffer>

next

public java.nio.ByteBuffer next()

Specified by:

next in interface scala.collection.Iterator<java.nio.ByteBuffer>

close

public void close()

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface AutoCloseable