All Products
Search
Document Center

Data Lake Formation:Metadata management

Last Updated:Jun 25, 2024

Metadata management is important for building a data lake. Centralized data management can help improve data value. Data Lake Formation (DLF) provides the metadata management feature for you to manage metadatabases and metadata tables.

aeba4d4ad43d8fb0ab9ddb74cffbd3c7.png

Create a metadatabase

  1. Log on to the DLF console. In the left-side navigation pane, choose Metadata > Metadata.

  2. Click Create Database on the Database tab.

  3. Configure the information about the metadatabase that you want to create.

    image.png

    1. Select a data catalog for the metadatabase.

    2. Enter a name for the metadatabase.

    3. Optional. Enter a description for the metadatabase.

    4. Specify a path for the metadatabase.

Create a metadata table

  1. Click Create Table on the Table tab.

  2. Configure the information about the metadata table that you want to create.

    image.png

    1. Set a name for the metadata table.

    2. Select a data catalog for the metadata table.

    3. Select a database that belongs to the selected data catalog.

    4. Optional. Enter a description for the metadata table.

    5. Specify a location for storing the data of the metadata table.

    6. Select a data format for the metadata table.

    7. Select a delimiter for the metadata table.

    8. Define columns for the metadata table. For example, specify column IDs, column names, and partition key columns.

Delete a metadatabase

1. Choose Metadata > Metadata.

2. On the Database tab, find the desired metadatabase, and click Delete in the Actions column. In the message that appears, click Delete.

Note
  • The database named default is created in DLF by default and cannot be deleted. We recommend that you use other databases in production environments.

  • After you delete a database in the DLF console, the data stored in Object Storage Service (OSS) is not deleted. To delete the data from OSS, execute the DROP DATABASE statement in E-MapReduce (EMR) or MaxCompute.

删除元数据库

Delete a metadata table

1. Choose Metadata > Metadata.

2. Click the Table tab, find the desired metadata table, and click Delete in the Actions column. In the message that appears, click Delete.

Note

After you delete a metadata table in the DLF console, the data stored in OSS is not deleted. To delete the data from OSS, execute the DROP TABLE statement in EMR or MaxCompute.

删除元数据表