org.apache.hadoop.hive.ql.io

Class RCFileOutputFormat

java.lang.Object

<any>

org.apache.hadoop.hive.ql.io.RCFileOutputFormat

All Implemented Interfaces:

HiveOutputFormat<WritableComparable,BytesRefArrayWritable>

public class RCFileOutputFormat
extends <any>
implements HiveOutputFormat<WritableComparable,BytesRefArrayWritable>

RCFileOutputFormat.

Constructor Summary

Constructors

Constructor and Description
RCFileOutputFormat()

Method Summary

Modifier and Type	Method and Description
static int	getColumnNumber(Configuration conf) Returns the number of columns set in the conf for writers.
FileSinkOperator.RecordWriter	getHiveRecordWriter(JobConf jc, Path finalOutPath, java.lang.Class<? extends Writable> valueClass, boolean isCompressed, java.util.Properties tableProperties, Progressable progress) create the final out file.
<any>	getRecordWriter(FileSystem ignored, JobConf job, java.lang.String name, Progressable progress)
static void	setColumnNumber(Configuration conf, int columnNum) set number of columns into the given configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileOutputFormat

public RCFileOutputFormat()

Method Detail

setColumnNumber

public static void setColumnNumber(Configuration conf,
                                   int columnNum)

set number of columns into the given configuration.

Parameters:

conf - configuration instance which need to set the column number

columnNum - column number for RCFile's Writer

getColumnNumber

public static int getColumnNumber(Configuration conf)

Returns the number of columns set in the conf for writers.

Parameters:

conf -

Returns:

number of columns for RCFile's writer

getRecordWriter

public <any> getRecordWriter(FileSystem ignored,
                             JobConf job,
                             java.lang.String name,
                             Progressable progress)
                      throws java.io.IOException

Throws:

java.io.IOException

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(JobConf jc,
                                                         Path finalOutPath,
                                                         java.lang.Class<? extends Writable> valueClass,
                                                         boolean isCompressed,
                                                         java.util.Properties tableProperties,
                                                         Progressable progress)
                                                  throws java.io.IOException

create the final out file.

Specified by:

getHiveRecordWriter in interface HiveOutputFormat<WritableComparable,BytesRefArrayWritable>

Parameters:

jc - the job configuration file

finalOutPath - the final output file to be created

valueClass - the value class used for create

isCompressed - whether the content is compressed or not

tableProperties - the tableInfo of this file's corresponding table

progress - progress used for status report

Returns:

the RecordWriter for the output file

Throws:

java.io.IOException