org.apache.spark.input

Class FixedLengthBinaryRecordReader

Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

org.apache.spark.input.FixedLengthBinaryRecordReader

All Implemented Interfaces:

java.io.Closeable, AutoCloseable

public class FixedLengthBinaryRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

FixedLengthBinaryRecordReader is returned by FixedLengthBinaryInputFormat. It uses the record length set in FixedLengthBinaryInputFormat to read one record at a time from the given InputSplit.

Each call to nextKeyValue() updates the LongWritable key and BytesWritable value.

key = record index (Long) value = the record itself (BytesWritable)

Constructor Summary

Constructors

Constructor and Description
FixedLengthBinaryRecordReader()

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.LongWritable	getCurrentKey()
org.apache.hadoop.io.BytesWritable	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FixedLengthBinaryRecordReader

public FixedLengthBinaryRecordReader()

Method Detail

close

public void close()

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

getCurrentKey

public org.apache.hadoop.io.LongWritable getCurrentKey()

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

getCurrentValue

public org.apache.hadoop.io.BytesWritable getCurrentValue()

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

getProgress

public float getProgress()

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
              org.apache.hadoop.mapreduce.TaskAttemptContext context)

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

nextKeyValue

public boolean nextKeyValue()

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>