org.apache.iceberg.arrow.vectorized

Class VectorizedTableScanIterable

java.lang.Object

org.apache.iceberg.io.CloseableGroup

org.apache.iceberg.arrow.vectorized.VectorizedTableScanIterable

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, java.lang.Iterable<ColumnarBatch>, CloseableIterable<ColumnarBatch>

public class VectorizedTableScanIterable
extends CloseableGroup
implements CloseableIterable<ColumnarBatch>

A vectorized implementation of the Iceberg reader that iterates over the table scan. See ArrowReader for details.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.iceberg.io.CloseableIterable

CloseableIterable.ConcatCloseableIterable<E>

Constructor Summary

Constructors

Constructor and Description
VectorizedTableScanIterable(TableScan scan) Create a new instance using default values for batchSize and reuseContainers.
VectorizedTableScanIterable(TableScan scan, int batchSize, boolean reuseContainers) Create a new instance.

Method Summary

Modifier and Type	Method and Description
void	close() Close all the registered resources.
CloseableIterator<ColumnarBatch>	iterator() Returns a closeable iterator over elements of type T.

Methods inherited from class org.apache.iceberg.io.CloseableGroup

addCloseable, addCloseable, setSuppressCloseFailure

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.io.CloseableIterable

combine, concat, count, empty, filter, filter, transform, whenComplete, withNoopClose, withNoopClose

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

VectorizedTableScanIterable

public VectorizedTableScanIterable(TableScan scan)

Create a new instance using default values for batchSize and reuseContainers. The batchSize is set to BATCH_SIZE_IN_NUM_ROWS and reuseContainers is set to false.

VectorizedTableScanIterable

public VectorizedTableScanIterable(TableScan scan,
                                   int batchSize,
                                   boolean reuseContainers)

Create a new instance.

See ArrowReader(TableScan, int, boolean) for details.

Method Detail

iterator

public CloseableIterator<ColumnarBatch> iterator()

Description copied from interface: CloseableIterable

Returns a closeable iterator over elements of type T.

Specified by:

iterator in interface java.lang.Iterable<ColumnarBatch>

Specified by:

iterator in interface CloseableIterable<ColumnarBatch>

Returns:

an CloseableIterator.

close

public void close()
           throws java.io.IOException

Description copied from class: CloseableGroup

Close all the registered resources. Close method of each resource will only be called once. Checked exception from AutoCloseable will be wrapped to runtime exception.

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Overrides:

close in class CloseableGroup

Throws:

java.io.IOException