MaxCompute:Migrate MaxCompute data to Tablestore

Procedure

1. Activate services

   1. Activate MaxCompute

   2. Activate DataWorks

2. Create a table in DataWorks

   1. Log on to the DataWorks console and select a region in the upper-left corner.

   2. In the left navigation pane, click Workspace.

   3. On the Workspaces page, find the target workspace and in the Actions column, choose Shortcuts > DataStudio.

   4. On the Data Studio page, create a MaxCompute SQL node. Then, run the following statement to create a table named transs.

      CREATE TABLE transs
      (name    STRING,
      id    STRING,
      gender    STRING);

3. Import data into the transs table

   1. Save the following sample data to your computer as a CSV file.

      qwe,145,F
      asd,256,F
      xzc,345,M
      rgth,234,F
      ert,456,F
      dfg,12,M
      tyj,4,M
      bfg,245,M
      nrtjeryj,15,F
      rwh,2344,M
      trh,387,F
      srjeyj,67,M
      saerh,567,M

   2. In the left navigation pane, choose Data Integration > Data Upload and Download.

   3. Click Go to Data Upload and Download.

   4. In the left navigation pane, click the upload icon and then click Upload Data.

4. Create a table in the Tablestore console

   1. Log on to the Tablestore console and create an instance.

   2. Create a data table named trans. For more information, see Create a data table.

      Set the primary keys to name and id.

5. Add a MaxCompute data source in DataWorks

   1. Log on to the DataWorks console and select a region in the upper-left corner.

   2. In the left navigation pane, click Workspace.

   3. On the Workspaces page, click the name of the target workspace.

   4. On the Workspace Details page, click Data Sources in the left navigation pane.

   5. On the Data Source tab, click Add Data Source, and select MaxCompute.

   6. On the Add MaxCompute Data Source page, configure the Basic Information.

      For more information, see Configure a MaxCompute data source.

6. Add a Tablestore data source. For more information, see Configure a Tablestore data source.

7. Configure the MaxCompute (ODPS) Reader and the Tablestore (OTS) Writer

   1. Log on to the DataWorks console and select a region in the upper-left corner.

   2. In the left navigation pane, choose Data Development and O&M > Data Development.

   3. In the Select Workspace section, click Go to Data Studio.

   4. In the left pane of Data Studio, click the icon and select Create Node > Data Integration > Batch Synchronization.

      • Select Tablestore as the data source.

      • For Data Destination, select MaxCompute (ODPS).

   5. On the node configuration page, configure the following parameters.

      • Data Source-Source: Select the MaxCompute data source that you added.

      • Data Source-Destination: Select the Tablestore data source that you added.

      • Data Source > Table: Select an existing table in OTS.

      • Destination-Table: Select the Tablestore table that you created.

      • Runtime Resource: Select the exclusive resource group that you created.

      • Keep the default values for the other parameters.

      Alternatively, you can click the icon above the configuration section to switch to the code editor and configure the node using a script. The following code provides an example:

      {
          "type": "job",
          "steps": [
              {
                  "stepType": "odps",
                  "parameter": {
                      "partition": [],
                      "datasource": "odps_first",
                      "column": [
                          "name",
                          "id",
                          "gender"
                      ],
                      "table": "transs"
                  },
                  "name": "Reader",
                  "category": "reader"
              },
              {
                  "stepType": "ots",
                  "parameter": {
                      "datasource": "transs",
                      "column": [
                          {
                              "name": "gender",
                              "type": "STRING"
                          }
                      ],
                      "writeMode": "UpdateRow",
                      "table": "trans",
                      "primaryKey": [
                          {
                              "name": "name",
                              "type": "STRING"
                          },
                          {
                              "name": "id",
                              "type": "INT"
                          }
                      ]
                  },
                  "name": "Writer",
                  "category": "writer"
              }
          ],
          "version": "2.0",
          "order": {
              "hops": [
                  {
                      "from": "Reader",
                      "to": "Writer"
                  }
              ]
          },
          "setting": {
              "errorLimit": {
                  "record": "0"
              },
              "speed": {
                  "throttle": false,
                  "concurrent": 1,
                  "dmu": 1
              }
          }
      }

8. View the data in the Tablestore console.

   1. Log on to the Tablestore console. In the upper-left corner, select a region.

   2. In the navigation pane on the left, select All Instances.

   3. On the All Instances page, click the instance name to go to the Instance Management page.

   4. On the Instance Management page, click the Instance Details tab.

   5. On the Instance Details tab, in the Tables area, click the name of the data table that you want to view.

   6. On the data table management page, click the Query Data tab to view the data in the table.