org.apache.iceberg.arrow.vectorized.parquet

Class VectorizedColumnIterator

java.lang.Object

org.apache.iceberg.parquet.BaseColumnIterator

org.apache.iceberg.arrow.vectorized.parquet.VectorizedColumnIterator

public class VectorizedColumnIterator
extends BaseColumnIterator

Vectorized version of the ColumnIterator that reads column values in data pages of a column in a row group in a batched fashion.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	VectorizedColumnIterator.BatchReader
class	VectorizedColumnIterator.BooleanBatchReader
class	VectorizedColumnIterator.DictionaryBatchReader
class	VectorizedColumnIterator.DoubleBatchReader
class	VectorizedColumnIterator.FixedLengthDecimalBatchReader Deprecated. will be removed in 1.4.0
class	VectorizedColumnIterator.FixedSizeBinaryBatchReader
class	VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader
class	VectorizedColumnIterator.FloatBatchReader
class	VectorizedColumnIterator.IntBackedDecimalBatchReader Deprecated. will be removed in 1.4.0
class	VectorizedColumnIterator.IntegerBatchReader
class	VectorizedColumnIterator.LongBackedDecimalBatchReader Deprecated. will be removed in 1.4.0
class	VectorizedColumnIterator.LongBatchReader
class	VectorizedColumnIterator.TimestampInt96BatchReader
class	VectorizedColumnIterator.TimestampMillisBatchReader
class	VectorizedColumnIterator.VarWidthTypeBatchReader

Field Summary

Fields inherited from class org.apache.iceberg.parquet.BaseColumnIterator

advanceNextPageCount, desc, dictionary, pageSource, triplesCount, triplesRead

Constructor Summary

Constructors

Constructor and Description
VectorizedColumnIterator(org.apache.parquet.column.ColumnDescriptor desc, java.lang.String writerVersion, boolean setArrowValidityVector)

Method Summary

Modifier and Type	Method and Description
VectorizedColumnIterator.BooleanBatchReader	booleanBatchReader()
VectorizedColumnIterator.DictionaryBatchReader	dictionaryBatchReader()
VectorizedColumnIterator.DoubleBatchReader	doubleBatchReader()
VectorizedColumnIterator.FixedLengthDecimalBatchReader	fixedLengthDecimalBatchReader() Deprecated. will be removed in 1.4.0
VectorizedColumnIterator.FixedSizeBinaryBatchReader	fixedSizeBinaryBatchReader()
VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader	fixedWidthTypeBinaryBatchReader()
VectorizedColumnIterator.FloatBatchReader	floatBatchReader()
VectorizedColumnIterator.IntBackedDecimalBatchReader	intBackedDecimalBatchReader() Deprecated. will be removed in 1.4.0
VectorizedColumnIterator.IntegerBatchReader	integerBatchReader()
VectorizedColumnIterator.LongBackedDecimalBatchReader	longBackedDecimalBatchReader() Deprecated. will be removed in 1.4.0
VectorizedColumnIterator.LongBatchReader	longBatchReader()
protected BasePageIterator	pageIterator()
boolean	producesDictionaryEncodedVector()
void	setBatchSize(int batchSize)
org.apache.parquet.column.Dictionary	setRowGroupInfo(org.apache.parquet.column.page.PageReader store, boolean allPagesDictEncoded)
VectorizedColumnIterator.TimestampInt96BatchReader	timestampInt96BatchReader()
VectorizedColumnIterator.TimestampMillisBatchReader	timestampMillisBatchReader()
VectorizedColumnIterator.VarWidthTypeBatchReader	varWidthTypeBatchReader()

Methods inherited from class org.apache.iceberg.parquet.BaseColumnIterator

advance, hasNext, setPageSource

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VectorizedColumnIterator

public VectorizedColumnIterator(org.apache.parquet.column.ColumnDescriptor desc,
                                java.lang.String writerVersion,
                                boolean setArrowValidityVector)

Method Detail

setBatchSize

public void setBatchSize(int batchSize)

setRowGroupInfo

public org.apache.parquet.column.Dictionary setRowGroupInfo(org.apache.parquet.column.page.PageReader store,
                                                            boolean allPagesDictEncoded)

pageIterator

protected BasePageIterator pageIterator()

Specified by:

pageIterator in class BaseColumnIterator

producesDictionaryEncodedVector

public boolean producesDictionaryEncodedVector()

integerBatchReader

public VectorizedColumnIterator.IntegerBatchReader integerBatchReader()

dictionaryBatchReader

public VectorizedColumnIterator.DictionaryBatchReader dictionaryBatchReader()

longBatchReader

public VectorizedColumnIterator.LongBatchReader longBatchReader()

timestampMillisBatchReader

public VectorizedColumnIterator.TimestampMillisBatchReader timestampMillisBatchReader()

timestampInt96BatchReader

public VectorizedColumnIterator.TimestampInt96BatchReader timestampInt96BatchReader()

floatBatchReader

public VectorizedColumnIterator.FloatBatchReader floatBatchReader()

doubleBatchReader

public VectorizedColumnIterator.DoubleBatchReader doubleBatchReader()

intBackedDecimalBatchReader

@Deprecated
public VectorizedColumnIterator.IntBackedDecimalBatchReader intBackedDecimalBatchReader()

Deprecated. will be removed in 1.4.0

longBackedDecimalBatchReader

@Deprecated
public VectorizedColumnIterator.LongBackedDecimalBatchReader longBackedDecimalBatchReader()

Deprecated. will be removed in 1.4.0

fixedLengthDecimalBatchReader

@Deprecated
public VectorizedColumnIterator.FixedLengthDecimalBatchReader fixedLengthDecimalBatchReader()

Deprecated. will be removed in 1.4.0

fixedSizeBinaryBatchReader

public VectorizedColumnIterator.FixedSizeBinaryBatchReader fixedSizeBinaryBatchReader()

varWidthTypeBatchReader

public VectorizedColumnIterator.VarWidthTypeBatchReader varWidthTypeBatchReader()

fixedWidthTypeBinaryBatchReader

public VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader fixedWidthTypeBinaryBatchReader()

booleanBatchReader

public VectorizedColumnIterator.BooleanBatchReader booleanBatchReader()