org.apache.hadoop.hive.ql.io

Class BucketizedHiveRecordReader<K extends WritableComparable,V extends Writable>

java.lang.Object

org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader<K,V>

org.apache.hadoop.hive.ql.io.BucketizedHiveRecordReader<K,V>

public class BucketizedHiveRecordReader<K extends WritableComparable,V extends Writable>
extends HiveContextAwareRecordReader<K,V>

BucketizedHiveRecordReader is a wrapper on a list of RecordReader. It behaves similar as HiveRecordReader while it wraps a list of RecordReader from one file.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	idx
protected InputFormat	inputFormat
protected long	progress
protected Reporter	reporter
protected BucketizedHiveInputSplit	split

Fields inherited from class org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader

isSorted, jobConf, recordReader

Constructor Summary

Constructors

Constructor and Description
BucketizedHiveRecordReader(InputFormat inputFormat, BucketizedHiveInputSplit bucketizedSplit, JobConf jobConf, Reporter reporter)

Method Summary

Modifier and Type	Method and Description
K	createKey()
V	createValue()
void	doClose() Close this InputSplit to future operations.
boolean	doNext(K key, V value)
long	getPos()
float	getProgress()
protected boolean	initNextRecordReader() Get the record reader for the next chunk in this BucketizedHiveRecordReader.

Methods inherited from class org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader

close, foundAllTargets, getIOContext, initIOContext, initIOContext, initIOContext, initIOContextSortedProps, next, setRecordReader, updateIOContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

split

protected final BucketizedHiveInputSplit split

inputFormat

protected final InputFormat inputFormat

reporter

protected final Reporter reporter

progress

protected long progress

idx

protected int idx

Constructor Detail

BucketizedHiveRecordReader

public BucketizedHiveRecordReader(InputFormat inputFormat,
                                  BucketizedHiveInputSplit bucketizedSplit,
                                  JobConf jobConf,
                                  Reporter reporter)
                           throws java.io.IOException

Throws:

java.io.IOException

Method Detail

doClose

public void doClose()
             throws java.io.IOException

Description copied from class: HiveContextAwareRecordReader

Close this InputSplit to future operations.

Specified by:

doClose in class HiveContextAwareRecordReader<K extends WritableComparable,V extends Writable>

Throws:

java.io.IOException

createKey

public K createKey()

createValue

public V createValue()

getPos

public long getPos()
            throws java.io.IOException

Throws:

java.io.IOException

getProgress

public float getProgress()
                  throws java.io.IOException

Overrides:

getProgress in class HiveContextAwareRecordReader<K extends WritableComparable,V extends Writable>

Throws:

java.io.IOException

doNext

public boolean doNext(K key,
                      V value)
               throws java.io.IOException

Overrides:

doNext in class HiveContextAwareRecordReader<K extends WritableComparable,V extends Writable>

Throws:

java.io.IOException

initNextRecordReader

protected boolean initNextRecordReader()
                                throws java.io.IOException

Get the record reader for the next chunk in this BucketizedHiveRecordReader.

Throws:

java.io.IOException