| Package | Description |
|---|---|
| parquet.column.page | |
| parquet.column.statistics | |
| parquet.format.converter | |
| parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
| parquet.hadoop.metadata |
| Modifier and Type | Method and Description |
|---|---|
Statistics |
Page.getStatistics() |
| Modifier and Type | Method and Description |
|---|---|
void |
PageWriter.writePage(BytesInput bytesInput,
int valueCount,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
| Constructor and Description |
|---|
Page(BytesInput bytes,
int valueCount,
int uncompressedSize,
Statistics stats,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding) |
| Modifier and Type | Class and Description |
|---|---|
class |
BinaryStatistics |
class |
BooleanStatistics |
class |
DoubleStatistics |
class |
FloatStatistics |
class |
IntStatistics |
class |
LongStatistics |
| Modifier and Type | Method and Description |
|---|---|
static Statistics |
Statistics.getStatsBasedOnType(PrimitiveType.PrimitiveTypeName type)
Returns the typed statistics object based on the passed type parameter
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
Statistics.equals(Statistics stats)
Equality comparison method to compare two statistics objects.
|
void |
Statistics.mergeStatistics(Statistics stats)
Method to merge this statistics object with the object passed
as parameter.
|
void |
BooleanStatistics.mergeStatisticsMinMax(Statistics stats) |
protected abstract void |
Statistics.mergeStatisticsMinMax(Statistics stats)
Abstract method to merge this statistics min and max with the values
of the parameter object.
|
void |
FloatStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
DoubleStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
IntStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
LongStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
BinaryStatistics.mergeStatisticsMinMax(Statistics stats) |
| Modifier and Type | Method and Description |
|---|---|
static Statistics |
ParquetMetadataConverter.fromParquetStatistics(parquet.format.Statistics statistics,
PrimitiveType.PrimitiveTypeName type) |
| Modifier and Type | Method and Description |
|---|---|
static parquet.format.Statistics |
ParquetMetadataConverter.toParquetStatistics(Statistics statistics) |
void |
ParquetMetadataConverter.writeDataPageHeader(int uncompressedSize,
int compressedSize,
int valueCount,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding,
OutputStream to) |
| Modifier and Type | Method and Description |
|---|---|
void |
ParquetFileWriter.writeDataPage(int valueCount,
int uncompressedPageSize,
BytesInput bytes,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
| Modifier and Type | Method and Description |
|---|---|
abstract Statistics |
ColumnChunkMetaData.getStatistics() |
| Modifier and Type | Method and Description |
|---|---|
static ColumnChunkMetaData |
ColumnChunkMetaData.get(ColumnPath path,
PrimitiveType.PrimitiveTypeName type,
CompressionCodecName codec,
Set<Encoding> encodings,
Statistics statistics,
long firstDataPage,
long dictionaryPageOffset,
long valueCount,
long totalSize,
long totalUncompressedSize) |
Copyright © 2015. All rights reserved.