DataWorks:Solution 4: Connect to a data source on an ECS instance

Step 2: Establish network connectivity

Step 3: Add a resource group route

For cross-account or cross-region scenarios, you must add a route in the DataWorks resource group that points to the CIDR block of the ECS Instance's vSwitch.

1. Go to the Resource Groups page in the DataWorks console. Find the target resource group and click Network Settings in the Actions column.

2. In the corresponding feature module, find the bound VPC and click Custom Route in the Actions column.

3. Click Add Route. For Connection Method, select CIDR Block. For

   Destination CIDR Block
   , enter the CIDR block of the ECS Instance's vSwitch.

1. Basic information

2. Establish network connectivity

This example uses a VPC Peering Connection to connect the ECS Instance and DataWorks.

1. Log on to Account A. Go to the VPC Peering Connection page of the VPC console. In the top navigation bar, select the China (Hangzhou) region, then click Create Peering Connection and configure the parameters.

   The following table describes the key parameters for this example. Keep the default values for other parameters.

   Parameter	Configuration
   Peering Connection Name	Enter a custom name. In this example, it is set to Account_A to Account_B.
   Requester VPC Instance	The VPC of the ECS Instance in Account A. In this example, Account_A_hangzhou_VPC is selected.
   Accepter Account Type	In this example, Cross-account is selected.
   Accepter UID	Enter the UID of Account B.
   Accepter Region Type	In this example, Cross-region is selected.
   Accepter Region	The region of the DataWorks workspace and resource group under Account B. Select China (Shanghai).
   Accepter VPC	Manually enter the VPC ID of the DataWorks resource group's VPC under Account B (Account_B_shanghai_VPC).

2. Click OK. The peering connection is configured and you are automatically taken to its details page. The status of the connection is now Peering Accepting.

3. Log on to Account B. Go to the VPC Peering Connection page of the VPC console. In the top navigation bar, select the China (Shanghai) region. You will see a peering connection record matching the one created in Account A. Click Accept in the Actions column. After you accept the request, the connection status changes to Activated.

4. Click Configure Route under Accepter VPC. In the Configure Route dialog box, enter a custom Name for the route entry, and set the Destination CIDR Block to the VPC CIDR block of the requester (the ECS Instance). In this example, it is 192.168.0.0/16.

   

5. Log on to Account A. Go to the VPC Peering Connection page of the VPC console. In the top navigation bar, select the China (Hangzhou) region and find the peering connection you created.

6. Click Configure Route under Requester VPC Instance. In the Configure Route dialog box, enter a custom Name for the route entry, and set the Destination CIDR Block to the VPC CIDR block of the accepter (the DataWorks resource group). In this example, it is 172.16.0.0/12.

   

3. Add a resource group route

1. Log on to Account B. Go to the Resource Groups page in the DataWorks console. Find the target resource group and click Network Settings in the Actions column.

2. In the corresponding feature module, find the bound VPC and click Custom Route in the Actions column.

3. Click Add Route. For Connection Method, select CIDR Block. For Destination CIDR Block, enter the CIDR block of the ECS Instance's vSwitch (in this example, 192.168.6.0/24).

4. Enable remote MySQL access

Connect to the ECS Instance where the MySQL database is deployed and enable remote access for the database.

1. Find the location of the my.cnf configuration file. By default, it is usually located at /etc/my.cnf.

   find / -name my.cnf

2. Use the vim /etc/my.cnf command to edit the configuration file. Replace the path with the actual path found in the previous step.

3. At the end of the file, press i and add the following configuration under [mysqld]:

   bind-address=0.0.0.0

4. Press Esc, then enter :wq! to save and exit.

5. Run the systemctl restart mysqld command to restart the service.

6. Create a user for the DataWorks remote connection.

   1. Use the mysql -u root -p command to log in to the database as an administrator.

   2. Create a user and set a password.

      -- "dataworks_user" is the username. You can customize it.
      -- "%" allows access from any IP address. You can specify an IP for fine-grained control.
      -- "StrongPassword123!" is the user password. You can customize it.
      CREATE USER 'dataworks_user'@'%' IDENTIFIED BY 'StrongPassword123!';

   3. Grant database privileges to the user.

      -- Run either of the following commands.
      
      -- Grant all privileges to the user (use with caution).
      GRANT ALL PRIVILEGES ON *.* TO 'dataworks_user'@'%' WITH GRANT OPTION;
      
      -- Grant privileges on a specific database (for example, mydatabase) to the user.
      GRANT ALL PRIVILEGES ON mydatabase.* TO 'dataworks_user'@'%' WITH GRANT OPTION;

   4. Run the FLUSH PRIVILEGES; command to refresh privileges, then exit the database (exit).

   5. Verify the remote connection.

      mysql -u dataworks_user -h <Primary private IP of ECS> -p

5. Configure the ECS security group

1. Log on to Account A. Go to the ECS console and in the top navigation bar, select the China (Hangzhou) region.

2. In the left-side navigation pane, choose Instances & Images > Instances. Find the ECS Instance where the MySQL database is deployed and click the Instance name to go to the Instance Details page.

3. Click the Security Groups tab. Click the name of the Security Group to go to the Security Group Details page.

4. In the Access Rule section, click Quick Add and configure the following key parameters. Keep the default values for other parameters.

   • Authorization Object: Enter the CIDR block of the DataWorks resource group's vSwitch (in this example, 172.16.66.0/24).

   • Port Range: Enter the port used by the database on the ECS Instance (in this example, 3306).

6. Test the connection

1. Log on to Account B.

2. Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Integration > Data Integration. On the page that appears, select the desired workspace from the drop-down list and click Go to Data Integration.

3. In the left-side navigation pane, click Data source to go to the Data Sources page, then click Add Data Source.

4. Select MySQL as the data source type and configure its connection parameters.

   • For Configuration Mode, select Connection String Mode.

   • For Host IP Address, enter the private IP address of the ECS Instance (in this example, 192.168.6.172).

   • Set Port to 3306.

   • For Database Name, enter the name of an existing database.

   • For Username and Password, use the dataworks_user credentials created in the 4. Enable remote MySQL access step.

5. In the Connection Configuration section, click Test Network Connectivity for the resource group bound to the workspace. Verify that the result is passed.

   

   Note

   If the connectivity test Fails, you can use the Connectivity Diagnosis Tool to troubleshoot the issue. If you still cannot connect the Resource Group to the data source, submit a ticket for assistance.