Package | Description |
---|---|
parquet.column.page | |
parquet.column.statistics | |
parquet.format.converter | |
parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
parquet.hadoop.metadata |
Modifier and Type | Method and Description |
---|---|
Statistics |
Page.getStatistics() |
Modifier and Type | Method and Description |
---|---|
void |
PageWriter.writePage(BytesInput bytesInput,
int valueCount,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
Constructor and Description |
---|
Page(BytesInput bytes,
int valueCount,
int uncompressedSize,
Statistics stats,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding) |
Modifier and Type | Class and Description |
---|---|
class |
BinaryStatistics |
class |
BooleanStatistics |
class |
DoubleStatistics |
class |
FloatStatistics |
class |
IntStatistics |
class |
LongStatistics |
Modifier and Type | Method and Description |
---|---|
static Statistics |
Statistics.getStatsBasedOnType(PrimitiveType.PrimitiveTypeName type)
Returns the typed statistics object based on the passed type parameter
|
Modifier and Type | Method and Description |
---|---|
boolean |
Statistics.equals(Statistics stats)
Equality comparison method to compare two statistics objects.
|
void |
Statistics.mergeStatistics(Statistics stats)
Method to merge this statistics object with the object passed
as parameter.
|
void |
IntStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
FloatStatistics.mergeStatisticsMinMax(Statistics stats) |
protected abstract void |
Statistics.mergeStatisticsMinMax(Statistics stats)
Abstract method to merge this statistics min and max with the values
of the parameter object.
|
void |
BinaryStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
BooleanStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
LongStatistics.mergeStatisticsMinMax(Statistics stats) |
void |
DoubleStatistics.mergeStatisticsMinMax(Statistics stats) |
Modifier and Type | Method and Description |
---|---|
static Statistics |
ParquetMetadataConverter.fromParquetStatistics(parquet.format.Statistics statistics,
PrimitiveType.PrimitiveTypeName type) |
Modifier and Type | Method and Description |
---|---|
static parquet.format.Statistics |
ParquetMetadataConverter.toParquetStatistics(Statistics statistics) |
void |
ParquetMetadataConverter.writeDataPageHeader(int uncompressedSize,
int compressedSize,
int valueCount,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding,
OutputStream to) |
Modifier and Type | Method and Description |
---|---|
void |
ParquetFileWriter.writeDataPage(int valueCount,
int uncompressedPageSize,
BytesInput bytes,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
Modifier and Type | Method and Description |
---|---|
abstract Statistics |
ColumnChunkMetaData.getStatistics() |
Modifier and Type | Method and Description |
---|---|
static ColumnChunkMetaData |
ColumnChunkMetaData.get(ColumnPath path,
PrimitiveType.PrimitiveTypeName type,
CompressionCodecName codec,
Set<Encoding> encodings,
Statistics statistics,
long firstDataPage,
long dictionaryPageOffset,
long valueCount,
long totalSize,
long totalUncompressedSize) |
Copyright © 2015. All rights reserved.