parquet.avro

Class AvroWriteSupport

java.lang.Object

parquet.hadoop.api.WriteSupport<org.apache.avro.generic.IndexedRecord>

parquet.avro.AvroWriteSupport

public class AvroWriteSupport
extends WriteSupport<org.apache.avro.generic.IndexedRecord>

Avro implementation of WriteSupport for IndexedRecords - both Avro Generic and Specific. Users should use AvroParquetWriter or AvroParquetOutputFormat rather than using this class directly.

Nested Class Summary

Nested classes/interfaces inherited from class parquet.hadoop.api.WriteSupport

WriteSupport.WriteContext

Constructor Summary

Constructors

Constructor and Description
AvroWriteSupport()
AvroWriteSupport(MessageType schema, org.apache.avro.Schema avroSchema)

Method Summary

Modifier and Type	Method and Description
WriteSupport.WriteContext	init(org.apache.hadoop.conf.Configuration configuration) called first in the task
void	prepareForWrite(RecordConsumer recordConsumer) This will be called once per row group
static void	setSchema(org.apache.hadoop.conf.Configuration configuration, org.apache.avro.Schema schema)
void	write(org.apache.avro.generic.IndexedRecord record) called once per record

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroWriteSupport

public AvroWriteSupport()

AvroWriteSupport

public AvroWriteSupport(MessageType schema,
                        org.apache.avro.Schema avroSchema)

Method Detail

setSchema

public static void setSchema(org.apache.hadoop.conf.Configuration configuration,
                             org.apache.avro.Schema schema)

See Also:

AvroParquetOutputFormat.setSchema(org.apache.hadoop.mapreduce.Job, org.apache.avro.Schema)

init

public WriteSupport.WriteContext init(org.apache.hadoop.conf.Configuration configuration)

Description copied from class: WriteSupport

called first in the task

Specified by:

init in class WriteSupport<org.apache.avro.generic.IndexedRecord>

Parameters:

configuration - the job's configuration

Returns:

the information needed to write the file

prepareForWrite

public void prepareForWrite(RecordConsumer recordConsumer)

Description copied from class: WriteSupport

This will be called once per row group

Specified by:

prepareForWrite in class WriteSupport<org.apache.avro.generic.IndexedRecord>

Parameters:

recordConsumer - the recordConsumer to write to

write

public void write(org.apache.avro.generic.IndexedRecord record)

Description copied from class: WriteSupport

called once per record

Specified by:

write in class WriteSupport<org.apache.avro.generic.IndexedRecord>

Parameters:

record - one record to write to the previously provided record consumer