public class TableMigrationUtil
extends java.lang.Object
Modifier and Type | Method and Description |
---|---|
static java.util.List<DataFile> |
listPartition(java.util.Map<java.lang.String,java.lang.String> partition,
java.lang.String uri,
java.lang.String format,
PartitionSpec spec,
org.apache.hadoop.conf.Configuration conf,
MetricsConfig metricsConfig,
NameMapping mapping)
Returns the data files in a partition by listing the partition location.
|
static java.util.List<DataFile> |
listPartition(java.util.Map<java.lang.String,java.lang.String> partitionPath,
java.lang.String partitionUri,
java.lang.String format,
PartitionSpec spec,
org.apache.hadoop.conf.Configuration conf,
MetricsConfig metricsSpec,
NameMapping mapping,
int parallelism) |
public static java.util.List<DataFile> listPartition(java.util.Map<java.lang.String,java.lang.String> partition, java.lang.String uri, java.lang.String format, PartitionSpec spec, org.apache.hadoop.conf.Configuration conf, MetricsConfig metricsConfig, NameMapping mapping)
For Parquet and ORC partitions, this will read metrics from the file footer. For Avro partitions, metrics are set to null.
Note: certain metrics, like NaN counts, that are only supported by iceberg file writers but not file footers, will not be populated.
partition
- partition key, e.g., "a=1/b=2"uri
- partition location URIformat
- partition format, avro, parquet or orcspec
- a partition specconf
- a Hadoop confmetricsConfig
- a metrics confmapping
- a name mappingpublic static java.util.List<DataFile> listPartition(java.util.Map<java.lang.String,java.lang.String> partitionPath, java.lang.String partitionUri, java.lang.String format, PartitionSpec spec, org.apache.hadoop.conf.Configuration conf, MetricsConfig metricsSpec, NameMapping mapping, int parallelism)