All Products
Search
Document Center

Platform For AI:Read Table

Last Updated:Dec 30, 2022

The Read Table component reads data from MaxCompute tables. By default, the component reads the table data of the current project. To read data from tables in other projects, you must prefix the table names with the related project names.

Note

The algorithm components of Machine Learning Designer support the following data types: DOUBLE, BIGINT, STRING, BOOLEAN, and DATETIME. The Read Table component supports all types of data. To prevent errors in other algorithm components, you can connect a data conversion component as the downstream component of the Read Table component.

You can configure the Read Table component only in the Machine Learning Platform for AI console. The following table describes the parameters of this component.

Tab

Parameter

Description

Select Table

Table Name

The name of the MaxCompute table from which you want to read data. If you want to read data from a MaxCompute table in another project, set this parameter in the Project name.Table name format. Example: tianchi_project.weibo_data.

Important

If the fields in the MaxCompute table are modified, the modifications cannot be synchronized to Machine Learning Designer. You must manually configure the MaxCompute data source again.

Partition

If the input table is a partitioned table, you can select the Partition check box and set Parameter to query data by partition.

Note

If the SQL Script component is the downstream component of the Read Table component, the filter condition does not take effect. You must configure the filter condition in the SQL Script component.

Parameter

The partition that you want to filter. This parameter is used to filter data of the partitioned table. Separate multiple partitions with commas (,). If you do not specify this parameter, the full table is used. Examples:

  • For a dynamic partitioned table, enter a value in the dt=${yyyyMMdd} format. ${yyyyMMdd} is a system parameter that represents the current date and ${yyyyMMdd-1d} represents the day before the current date.

  • For a standard partitioned table, enter partition conditions. Example: ds=1,ds=2.

  • For a multi-level partitioned table, use /to separate multi-level partitions. Example: ds=1/name=cat,ds=2/name=dog..

  • Use global variables. Example: ds=${a}/name=${b}/tag=${c}. You can configure a, b, and c on the Global Variables tab of the pipeline.

Fields Information

Source Table Columns

After you set the Table Name parameter, the system automatically reads the table schema.