public class EcsCatalog extends BaseMetastoreCatalog implements java.io.Closeable, SupportsNamespaces, Configurable<java.lang.Object>
BaseMetastoreCatalog.BaseMetastoreCatalogTableBuilder
Catalog.TableBuilder
Constructor and Description |
---|
EcsCatalog()
No-arg constructor to load the catalog dynamically.
|
Modifier and Type | Method and Description |
---|---|
void |
close() |
void |
createNamespace(Namespace namespace,
java.util.Map<java.lang.String,java.lang.String> properties)
Create a namespace in the catalog.
|
protected java.lang.String |
defaultWarehouseLocation(TableIdentifier tableIdentifier) |
boolean |
dropNamespace(Namespace namespace)
Drop a namespace.
|
boolean |
dropTable(TableIdentifier identifier,
boolean purge)
Remove table object.
|
void |
initialize(java.lang.String name,
java.util.Map<java.lang.String,java.lang.String> properties)
Initialize a catalog given a custom name and a map of catalog properties.
|
java.util.List<Namespace> |
listNamespaces(Namespace namespace)
List namespaces from the namespace.
|
java.util.List<TableIdentifier> |
listTables(Namespace namespace)
Iterate all table objects with the namespace prefix.
|
java.util.Map<java.lang.String,java.lang.String> |
loadNamespaceMetadata(Namespace namespace)
Load namespace properties.
|
java.lang.String |
name()
Return the name for this catalog.
|
boolean |
namespaceExists(Namespace namespace)
Checks whether the Namespace exists.
|
protected TableOperations |
newTableOps(TableIdentifier tableIdentifier) |
java.util.Optional<com.emc.object.s3.S3ObjectMetadata> |
objectMetadata(org.apache.iceberg.dell.ecs.EcsURI uri)
Get S3 object metadata which include E-Tag, user metadata and so on.
|
protected java.util.Map<java.lang.String,java.lang.String> |
properties() |
boolean |
removeProperties(Namespace namespace,
java.util.Set<java.lang.String> properties)
Remove a set of property keys from a namespace in the catalog.
|
void |
renameTable(TableIdentifier from,
TableIdentifier to)
Table rename will only move table object, the data objects will still be in-place.
|
void |
setConf(java.lang.Object conf) |
boolean |
setProperties(Namespace namespace,
java.util.Map<java.lang.String,java.lang.String> properties)
Set a collection of properties on a namespace in the catalog.
|
boolean |
tableExists(TableIdentifier identifier)
Check whether table exists.
|
boolean |
updateProperties(Namespace namespace,
java.util.function.Consumer<java.util.Map<java.lang.String,java.lang.String>> propertiesFn) |
buildTable, fullTableName, isValidIdentifier, loadTable, registerTable, toString
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
createNamespace, listNamespaces
createTable, createTable, createTable, createTable, dropTable, invalidateTable, newCreateTableTransaction, newCreateTableTransaction, newCreateTableTransaction, newCreateTableTransaction, newReplaceTableTransaction, newReplaceTableTransaction, newReplaceTableTransaction, newReplaceTableTransaction
public EcsCatalog()
All fields are initialized by calling initialize(String, Map)
later.
public void initialize(java.lang.String name, java.util.Map<java.lang.String,java.lang.String> properties)
Catalog
A custom Catalog implementation must have a no-arg constructor. A compute engine like Spark or Flink will first initialize the catalog without any arguments, and then call this method to complete catalog initialization with properties passed into the engine.
initialize
in interface Catalog
name
- a custom name for the catalogproperties
- catalog propertiesprotected TableOperations newTableOps(TableIdentifier tableIdentifier)
newTableOps
in class BaseMetastoreCatalog
protected java.lang.String defaultWarehouseLocation(TableIdentifier tableIdentifier)
defaultWarehouseLocation
in class BaseMetastoreCatalog
public java.util.List<TableIdentifier> listTables(Namespace namespace)
listTables
in interface Catalog
namespace
- a namespacepublic boolean dropTable(TableIdentifier identifier, boolean purge)
public void renameTable(TableIdentifier from, TableIdentifier to)
renameTable
in interface Catalog
from
- identifier of the table to renameto
- new table namepublic void createNamespace(Namespace namespace, java.util.Map<java.lang.String,java.lang.String> properties)
SupportsNamespaces
createNamespace
in interface SupportsNamespaces
namespace
- a multi-part namespaceproperties
- a string Map of properties for the given namespacepublic java.util.List<Namespace> listNamespaces(Namespace namespace) throws NoSuchNamespaceException
SupportsNamespaces
For example, if table a.b.t exists, use 'SELECT NAMESPACE IN a' this method must return
Namepace.of("a","b") Namespace
.
listNamespaces
in interface SupportsNamespaces
Namespace
namesNoSuchNamespaceException
- If the namespace does not exist (optional)public java.util.Map<java.lang.String,java.lang.String> loadNamespaceMetadata(Namespace namespace) throws NoSuchNamespaceException
loadNamespaceMetadata
in interface SupportsNamespaces
namespace
- a namespace. Namespace
NoSuchNamespaceException
- If the namespace does not exist (optional)public boolean dropNamespace(Namespace namespace) throws NamespaceNotEmptyException
SupportsNamespaces
dropNamespace
in interface SupportsNamespaces
namespace
- a namespace. Namespace
NamespaceNotEmptyException
- If the namespace is not emptypublic boolean setProperties(Namespace namespace, java.util.Map<java.lang.String,java.lang.String> properties) throws NoSuchNamespaceException
SupportsNamespaces
Properties that are not in the given map are not modified or removed by this method.
setProperties
in interface SupportsNamespaces
namespace
- a namespace. Namespace
properties
- a collection of metadata to apply to the namespaceNoSuchNamespaceException
- If the namespace does not exist (optional)public boolean removeProperties(Namespace namespace, java.util.Set<java.lang.String> properties) throws NoSuchNamespaceException
SupportsNamespaces
Properties that are not in the given set are not modified or removed by this method.
removeProperties
in interface SupportsNamespaces
namespace
- a namespace. Namespace
properties
- a collection of metadata to apply to the namespaceNoSuchNamespaceException
- If the namespace does not exist (optional)public boolean updateProperties(Namespace namespace, java.util.function.Consumer<java.util.Map<java.lang.String,java.lang.String>> propertiesFn) throws NoSuchNamespaceException
NoSuchNamespaceException
public boolean namespaceExists(Namespace namespace)
SupportsNamespaces
namespaceExists
in interface SupportsNamespaces
namespace
- a namespace. Namespace
public boolean tableExists(TableIdentifier identifier)
Catalog
tableExists
in interface Catalog
identifier
- a table identifierpublic java.util.Optional<com.emc.object.s3.S3ObjectMetadata> objectMetadata(org.apache.iceberg.dell.ecs.EcsURI uri)
public java.lang.String name()
Catalog
public void close() throws java.io.IOException
close
in interface java.io.Closeable
close
in interface java.lang.AutoCloseable
java.io.IOException
public void setConf(java.lang.Object conf)
setConf
in interface Configurable<java.lang.Object>
protected java.util.Map<java.lang.String,java.lang.String> properties()
properties
in class BaseMetastoreCatalog