DataWorks allows you to manage the following settings for tables on the Table Management tab of the DataStudio page in the DataWorks console: partition formats, identifiers of partition fields, identifiers of temporary tables and import tables, folders, layers, and categories. You can store tables of the same type in the same folder or layer based on dimensions such as the use scenarios and categories of tables. This way, you can quickly obtain the category of a table based on the table name.
Limits
Only a workspace administrator or workspace owner can configure table-related formats, folders, and layers. If you want to configure the settings as a RAM user, you must add the RAM user to your workspace as a member and assign the Workspace Manager or Workspace Owner role to the member. For more information, see the Add a RAM user to a workspace as a member and assign roles to the member section in the Manage permissions on workspace-level services topic.
Go to the Table Management tab
Go to the DataStudio page.
Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose . On the page that appears, select the desired workspace from the drop-down list and click Go to Data Development.
Go to the Table Management tab.
Go to the Table Management tab by following the instructions shown in the following figure.
On the Table Management tab, you can perform the following operations:Configure table-related formats. For more information, see the Configure table-related formats section in this topic.
Create or manage folders for tables. For more information, see the Create or manage folders for tables section in this topic.
Create or manage layers or categories for tables. For more information, see the Create or manage layers or categories for tables section in this topic.
Configure table-related formats
On the Table Management tab, you can configure partition formats, identifiers of partition fields, and table name prefixes. This way, you can identify different tables and quickly determine the category of a table based on the table name. DataWorks provides a default partition format, a default identifier of partition fields, and default table name prefixes. You can customize the settings based on your business requirements.
Only a workspace administrator or workspace owner can configure table-related formats. If you want to configure the settings as a RAM user, you must add the RAM user to your workspace as a member and assign the Workspace Manager or Workspace Owner role to the member. For more information, see the Add a RAM user to a workspace as a member and assign roles to the member section in the Manage permissions on workspace-level services topic.
The following table describes the parameters.
Parameter | Description |
Partition Date Format | The date format of a partitioned table. Default value: YYYYMMDD. |
Partition Field Name | The identifier of a partition field. We recommend that you set this parameter to dt. |
Temporary Table Prefix | The prefix for the name of a temporary table. Default value: t_. The automatic parsing feature does not apply to temporary tables whose names are prefixed with t_. |
Upload Table (Import Table) Prefix | The prefix for the name of a table that is uploaded or imported to DataStudio. Example: upload_. |
Create or manage folders for tables
Folders are used to store and manage tables in a workspace. You can create different folders based on dimensions such as the use scenarios and categories of tables. This way, you can store tables of the same type in the same folder for centralized management.
Create or manage a folder
You can create, modify, or delete a folder. The following figure shows how to create a folder.
NoteDescription for required permissions
Only a workspace administrator or workspace owner can create or manage folders. If you want to configure the settings as a RAM user, you must add the RAM user to your workspace as a member and assign the Workspace Manager or Workspace Owner role to the member. For more information, see the Add a RAM user to a workspace as a member and assign roles to the member section in the Manage permissions on workspace-level services topic.
Description for folder creation
If you select Root Folder (To Create Level 1 Folder) for Parent Folder when you create a folder, the folder is a top-level folder. If you select an existing folder for Root Folder (To Create Level 1 Folder) when you create a folder, the folder is a subfolder of the existing folder. You can create a maximum of two levels of folders.
Subsequent operations
After a folder is created, you can perform the following operations on the folder:
Store a table in the folder when you create the table. The following table lists the types of tables that you can create.
Table type
References
MaxCompute
AnalyticDB for PostgreSQL
EMR
Hologres internal table
Hologres external table
Search for a table in the folder in the Workspace Tables pane of the DataStudio page. For more information, see Manage tables.
Create or manage layers or categories for tables
The layer management feature allows you to design physical layers and categories for tables. Layers and categories are designed to facilitate table management and do not require the implementation of the underlying logic.
Only a workspace administrator or workspace owner can create or manage layers and categories. If you want to configure the settings as a RAM user, you must add the RAM user to your workspace as a member and assign the Workspace Manager or Workspace Owner role to the member. For more information, see the Add a RAM user to a workspace as a member and assign roles to the member section in the Manage permissions on workspace-level services topic.
Terms
Term
Description
Layer
Data layering is used to design the structure of a data model and determine the physical layer to which the data model belongs based on the comprehensive analysis of business scenarios, data scenarios, and system scenarios.
The following layers are provided:
Operational data store (ODS)
Dimension (DIM)
Data warehouse detail (DWD)
Data warehouse summary (DWS)
Application data service (ADS)
Each data layer serves a specific purpose. Data layering can help you organize, manage, and maintain data in a more efficient manner. You can also create custom layers based on your business requirements.
Category
Categories help you classify tables in a finer-grained manner based on your business requirements. For example, you can use a basic business category, an advanced business category, or a category for another purpose to classify your tables.
You can also create custom categories based on your business requirements.
Create or manage a layer or category
You can create, modify, or delete a layer or category. The following figure shows how to create a layer or category.
Subsequent operations
After a layer or category is created, you can store a table in the layer or category when you create the table. The following table lists the types of tables that you can create.
Table type
References
MaxCompute
AnalyticDB for PostgreSQL
EMR
Hologres internal table
Hologres external table