org.apache.hadoop.hive.ql.io

Class CombineHiveInputFormat.CombineHiveInputSplit

java.lang.Object

org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.CombineHiveInputSplit

All Implemented Interfaces:

HadoopShims.InputSplitShim

Enclosing class:

CombineHiveInputFormat<K extends WritableComparable,V extends Writable>

public static class CombineHiveInputFormat.CombineHiveInputSplit
extends java.lang.Object
implements HadoopShims.InputSplitShim

CombineHiveInputSplit encapsulates an InputSplit with its corresponding inputFormatClassName. A CombineHiveInputSplit comprises of multiple chunks from different files. Since, they belong to a single directory, there is a single inputformat for all the chunks.

Constructor Summary

Constructors

Constructor and Description
CombineHiveInputSplit()
CombineHiveInputSplit(HadoopShims.InputSplitShim inputSplitShim)
CombineHiveInputSplit(JobConf job, HadoopShims.InputSplitShim inputSplitShim)

Method Summary

Modifier and Type	Method and Description
HadoopShims.InputSplitShim	getInputSplitShim()
JobConf	getJob()
long	getLength()
long	getLength(int i) Returns the length of the ith Path.
long[]	getLengths() Returns an array containing the lengths of the files in the split.
java.lang.String[]	getLocations() Returns all the Paths where this input-split resides.
int	getNumPaths() Returns the number of Paths in the split.
long	getOffset(int i) Returns the start offset of the ith Path.
Path	getPath(int i) Returns the ith Path.
Path[]	getPaths() Returns all the Paths in the split.
long[]	getStartOffsets() Returns an array containing the startoffsets of the files in the split.
java.lang.String	inputFormatClassName() Returns the inputFormat class name for the i-th chunk.
void	readFields(java.io.DataInput in) Writable interface.
void	setInputFormatClassName(java.lang.String inputFormatClassName)
void	shrinkSplit(long length)
java.lang.String	toString() Prints this obejct as a string.
void	write(java.io.DataOutput out) Writable interface.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CombineHiveInputSplit

public CombineHiveInputSplit()
                      throws java.io.IOException

Throws:

java.io.IOException

CombineHiveInputSplit

public CombineHiveInputSplit(HadoopShims.InputSplitShim inputSplitShim)
                      throws java.io.IOException

Throws:

java.io.IOException

CombineHiveInputSplit

public CombineHiveInputSplit(JobConf job,
                             HadoopShims.InputSplitShim inputSplitShim)
                      throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getInputSplitShim

public HadoopShims.InputSplitShim getInputSplitShim()

inputFormatClassName

public java.lang.String inputFormatClassName()

Returns the inputFormat class name for the i-th chunk.

setInputFormatClassName

public void setInputFormatClassName(java.lang.String inputFormatClassName)

getJob

public JobConf getJob()

Specified by:

getJob in interface HadoopShims.InputSplitShim

getLength

public long getLength()

Specified by:

getLength in interface HadoopShims.InputSplitShim

getStartOffsets

public long[] getStartOffsets()

Returns an array containing the startoffsets of the files in the split.

Specified by:

getStartOffsets in interface HadoopShims.InputSplitShim

getLengths

public long[] getLengths()

Returns an array containing the lengths of the files in the split.

Specified by:

getLengths in interface HadoopShims.InputSplitShim

getOffset

public long getOffset(int i)

Returns the start offset of the i^th Path.

Specified by:

getOffset in interface HadoopShims.InputSplitShim

getLength

public long getLength(int i)

Returns the length of the i^th Path.

Specified by:

getLength in interface HadoopShims.InputSplitShim

getNumPaths

public int getNumPaths()

Returns the number of Paths in the split.

Specified by:

getNumPaths in interface HadoopShims.InputSplitShim

getPath

public Path getPath(int i)

Returns the i^th Path.

Specified by:

getPath in interface HadoopShims.InputSplitShim

getPaths

public Path[] getPaths()

Returns all the Paths in the split.

Specified by:

getPaths in interface HadoopShims.InputSplitShim

getLocations

public java.lang.String[] getLocations()
                                throws java.io.IOException

Returns all the Paths where this input-split resides.

Specified by:

getLocations in interface HadoopShims.InputSplitShim

Throws:

java.io.IOException

toString

public java.lang.String toString()

Prints this obejct as a string.

Specified by:

toString in interface HadoopShims.InputSplitShim

Overrides:

toString in class java.lang.Object

readFields

public void readFields(java.io.DataInput in)
                throws java.io.IOException

Writable interface.

Specified by:

readFields in interface HadoopShims.InputSplitShim

Throws:

java.io.IOException

write

public void write(java.io.DataOutput out)
           throws java.io.IOException

Writable interface.

Specified by:

write in interface HadoopShims.InputSplitShim

Throws:

java.io.IOException

shrinkSplit

public void shrinkSplit(long length)

Specified by:

shrinkSplit in interface HadoopShims.InputSplitShim