org.apache.iceberg.hadoop

Class Util

java.lang.Object

org.apache.iceberg.hadoop.Util

public class Util
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	VERSION_HINT_FILENAME

Method Summary

Modifier and Type	Method and Description
static java.lang.String[]	blockLocations(CombinedScanTask task, org.apache.hadoop.conf.Configuration conf)
static java.lang.String[]	blockLocations(FileIO io, ScanTaskGroup<?> taskGroup)
static org.apache.hadoop.fs.FileSystem	getFs(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf)
static boolean	mayHaveBlockLocations(FileIO io, java.lang.String location)
static java.lang.String	uriToString(java.net.URI uri) From Apache Spark

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

VERSION_HINT_FILENAME

public static final java.lang.String VERSION_HINT_FILENAME

See Also:

Constant Field Values

Method Detail

getFs

public static org.apache.hadoop.fs.FileSystem getFs(org.apache.hadoop.fs.Path path,
                                                    org.apache.hadoop.conf.Configuration conf)

blockLocations

public static java.lang.String[] blockLocations(CombinedScanTask task,
                                                org.apache.hadoop.conf.Configuration conf)

blockLocations

public static java.lang.String[] blockLocations(FileIO io,
                                                ScanTaskGroup<?> taskGroup)

mayHaveBlockLocations

public static boolean mayHaveBlockLocations(FileIO io,
                                            java.lang.String location)

uriToString

public static java.lang.String uriToString(java.net.URI uri)

From Apache Spark

Convert URI to String. Since URI.toString does not decode the uri, e.g. change '%25' to '%'. Here we create a hadoop Path with the given URI, and rely on Path.toString to decode the uri

Parameters:

uri - the URI of the path

Returns:

the String of the path