All Products
Search

This Product

    Data Lake Formation:Metadata management

    Document Center

    Data Lake Formation:Metadata management

    Last Updated:Jun 25, 2024

    Metadata management is important for building a data lake. Centralized data management can help improve data value. Data Lake Formation (DLF) provides the metadata management feature for you to manage metadatabases and metadata tables.

    aeba4d4ad43d8fb0ab9ddb74cffbd3c7.png

    Create a metadatabase

    1. Log on to the DLF console. In the left-side navigation pane, choose Metadata > Metadata.

    2. Click Create Database on the Database tab.

    3. Configure the information about the metadatabase that you want to create.

      image.png

      1. Select a data catalog for the metadatabase.

      2. Enter a name for the metadatabase.

      3. Optional. Enter a description for the metadatabase.

      4. Specify a path for the metadatabase.

    Create a metadata table

    1. Click Create Table on the Table tab.

    2. Configure the information about the metadata table that you want to create.

      image.png

      1. Set a name for the metadata table.

      2. Select a data catalog for the metadata table.

      3. Select a database that belongs to the selected data catalog.

      4. Optional. Enter a description for the metadata table.

      5. Specify a location for storing the data of the metadata table.

      6. Select a data format for the metadata table.

      7. Select a delimiter for the metadata table.

      8. Define columns for the metadata table. For example, specify column IDs, column names, and partition key columns.

    Delete a metadatabase

    1. Choose Metadata > Metadata.

    2. On the Database tab, find the desired metadatabase, and click Delete in the Actions column. In the message that appears, click Delete.

    Note

    • The database named default is created in DLF by default and cannot be deleted. We recommend that you use other databases in production environments.

    • After you delete a database in the DLF console, the data stored in Object Storage Service (OSS) is not deleted. To delete the data from OSS, execute the DROP DATABASE statement in E-MapReduce (EMR) or MaxCompute.

    删除元数据库

    Delete a metadata table

    1. Choose Metadata > Metadata.

    2. Click the Table tab, find the desired metadata table, and click Delete in the Actions column. In the message that appears, click Delete.

    Note

    After you delete a metadata table in the DLF console, the data stored in OSS is not deleted. To delete the data from OSS, execute the DROP TABLE statement in EMR or MaxCompute.

    删除元数据表