public abstract class BaseBatchReader<T> extends java.lang.Object implements VectorizedReader<T>
Modifier and Type | Field and Description |
---|---|
protected VectorizedArrowReader[] |
readers |
protected VectorHolder[] |
vectorHolders |
Modifier | Constructor and Description |
---|---|
protected |
BaseBatchReader(java.util.List<VectorizedReader<?>> readers) |
Modifier and Type | Method and Description |
---|---|
void |
close()
Release any resources allocated.
|
protected void |
closeVectors() |
void |
setBatchSize(int batchSize) |
void |
setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore,
java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData,
long rowPosition)
Sets the row group information to be used with this reader
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
read
protected final VectorizedArrowReader[] readers
protected final VectorHolder[] vectorHolders
protected BaseBatchReader(java.util.List<VectorizedReader<?>> readers)
public void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)
VectorizedReader
setRowGroupInfo
in interface VectorizedReader<T>
pageStore
- row group information for all the columnsmetaData
- map of ColumnPath
-> ColumnChunkMetaData
for the row grouprowPosition
- the row group's row offset in the parquet fileprotected void closeVectors()
public void close()
VectorizedReader
close
in interface VectorizedReader<T>
public void setBatchSize(int batchSize)
setBatchSize
in interface VectorizedReader<T>