| Package | Description |
|---|---|
| parquet.column | |
| parquet.column.impl | |
| parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
| Modifier and Type | Method and Description |
|---|---|
static ParquetProperties.WriterVersion |
ParquetProperties.WriterVersion.fromString(String name) |
ParquetProperties.WriterVersion |
ParquetProperties.getWriterVersion() |
static ParquetProperties.WriterVersion |
ParquetProperties.WriterVersion.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static ParquetProperties.WriterVersion[] |
ParquetProperties.WriterVersion.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Constructor and Description |
|---|
ParquetProperties(int dictPageSize,
ParquetProperties.WriterVersion writerVersion,
boolean enableDict) |
| Constructor and Description |
|---|
ColumnWriteStoreImpl(PageWriteStore pageWriteStore,
int pageSizeThreshold,
int initialSizePerCol,
int dictionaryPageSizeThreshold,
boolean enableDictionary,
ParquetProperties.WriterVersion writerVersion) |
| Modifier and Type | Field and Description |
|---|---|
static ParquetProperties.WriterVersion |
ParquetWriter.DEFAULT_WRITER_VERSION |
| Modifier and Type | Method and Description |
|---|---|
static ParquetProperties.WriterVersion |
ParquetOutputFormat.getWriterVersion(org.apache.hadoop.conf.Configuration configuration) |
| Constructor and Description |
|---|
ParquetRecordWriter(ParquetFileWriter w,
WriteSupport<T> writeSupport,
MessageType schema,
Map<String,String> extraMetaData,
int blockSize,
int pageSize,
CodecFactory.BytesCompressor compressor,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion) |
ParquetWriter(org.apache.hadoop.fs.Path file,
WriteSupport<T> writeSupport,
CompressionCodecName compressionCodecName,
int blockSize,
int pageSize,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion)
Create a new ParquetWriter.
|
ParquetWriter(org.apache.hadoop.fs.Path file,
WriteSupport<T> writeSupport,
CompressionCodecName compressionCodecName,
int blockSize,
int pageSize,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion,
org.apache.hadoop.conf.Configuration conf)
Create a new ParquetWriter.
|
Copyright © 2015. All rights reserved.