DataWorks:Exclusive resource groups

In which scenario do I need to use an exclusive resource group for scheduling?

If a node that is not used for data integration needs to access a data source that resides in a virtual private cloud (VPC) or a data source that is configured with a whitelist, you must use an exclusive resource group for scheduling. For more information, see Create and use an exclusive resource group for scheduling.

In which scenario do I need to use an exclusive resource group for Data Integration?

If you want to synchronize data from a data source that resides in a VPC, you must use an exclusive resource group for Data Integration. For more information, see Create and use an exclusive resource group for Data Integration.

How do I change the resource group for scheduling that is used to run a node?

1. If you want to change the resource group for scheduling used to test the running of a node that is in the development environment, perform the following operation:

   Click Run with Parameters in the top toolbar on the configuration tab of the node. In the Parameters dialog box, select the resource group that you want to use.

   

2. If you want to change the resource group for scheduling used to run a node that is in the production environment, use one of the following methods:

   • Change the resource group for scheduling on the configuration tab of the node. Then, commit and deploy the node for the change to take effect.

     On the configuration tab of the node, click the Properties tab in the right-side navigation pane. In the Resource Group section of the Properties tab, select the resource group that you want to use. Then, save the change, and commit and deploy the node for the change to take effect. For more information, see Configure the resource property.

   • Change the resource group for scheduling in Operation Center of the production environment.

     On the DataStudio page, click the icon in the upper-left corner and choose All Products > Data Development And Task Operation > Operation Center to navigate to the Operation Center page of the production environment. On the Operation Center page, choose Cycle Task Maintenance > Cycle Task in the left-side navigation pane. On the Cycle Task page, find the auto triggered node and choose More > Modify Scheduling Resource Group in the Actions column.

     
     Note

     Zero load nodes do not occupy resources. Therefore, you do not need to or cannot change the resource group for scheduling for a zero load node.

How do I change the resource group for Data Integration that is used to run a Data Integration node?

1. If you want to change the resource group for Data Integration used to test the running of a Data Integration node that is in the development environment, perform the following operation:

   On the configuration tab of the node, click Resource Group configuration in the right-side navigation pane. On the Resource Group configuration tab, select the exclusive resource group for Data Integration that you want to use from the Exclusive Resource Group drop-down list.

   Note

   If this exclusive resource group is also required in the production environment, you must select this resource group for this node and commit and deploy the node to the production environment.

2. If you want to change the resource group for Data Integration used to run a Data Integration node that is in the production environment, perform the following operations:

   On the DataStudio page, click the icon in the upper-left corner and choose All Products > Task Operation > Operation Center to navigate to the Operation Center page of the production environment. On the Operation Center page, choose Cycle Task Maintenance > Cycle Task in the left-side navigation pane. On the Cycle Task page, find the auto triggered node for which you want to change the resource group and click Modify Data Integration Resource Group in the lower part of the page.

   

How do I renew a resource group?

How do I change the specifications of an exclusive resource group? How do I scale in or out an exclusive resource group?

What conditions must be met before an exclusive resource group can access a data source that resides in a VPC?

How do I view the network environment of a data source?

• If you want to view the network environment of an ApsaraDB RDS data source, perform the following steps:

  1. Log on to the ApsaraDB RDS console.

  2. In the left-side navigation pane, click Instances. On the Instances page, find the instance whose network environment you want to view and click the instance name to go to the details page of the instance.

  3. In the left-side navigation pane of the instance details page, click Database Connection.

  4. On the Database Connection page, click Switch VSwitch.

  5. In the Switch vSwitch dialog box, view the vSwitch with which the data source is associated.

• If you want to view the network environment of a self-managed data source hosted on an Elastic Compute Service (ECS) instance, perform the following steps:

  1. Log on to the ECS console.

  2. In the left-side navigation pane, choose Instances & Images > Instances. On the Instances page, find the instance whose network environment you want to view and click the instance name to go to the details page of the instance.

  3. On the instance details page, view the configuration information of the instance.

What information about an exclusive resource group must be added to the whitelist of a data source that the exclusive resource group needs to access?

• If you want to use an exclusive resource group for Data Integration to run a node to synchronize data from a data source over a VPC, you must add the CIDR block of the vSwitch to which the exclusive resource group is bound to an IP address whitelist of the data source. To obtain and add the CIDR block of the vSwitch to which the resource group is bound to an IP address whitelist of the data source, perform the following operations:
  On the Exclusive Resource Groups tab of the DataWorks console, find the desired exclusive resource group for Data Integration and click Network Settings in the Actions column to view the CIDR block of the vSwitch to which the resource group is bound. Then, add the CIDR block to the IP address whitelist of the data source.
• If you want to use an exclusive resource group for Data Integration to run a node to synchronize data from a data source over the Internet, add the EIP of the exclusive resource group to an IP address whitelist of the data source. To obtain and add the EIP of the exclusive resource group for Data Integration to an IP address whitelist of the data source, perform the following operations:
  On the Exclusive Resource Groups tab of the DataWorks console, find the exclusive resource group for Data Integration whose EIP you want to view and click View Information in the Actions column. In the Exclusive Resource Groups dialog box, copy the EIP. Then, add the copied EIP to the IP address whitelist of the data source.
  Note If you upgrade the configuration of the exclusive resource group for Data Integration, you must check whether the EIP of the resource group changes. If the EIP of the resource group changes, add the new EIP to the IP address whitelist of the data source after the configuration upgrade. This ensures the normal running of your synchronization node.

How do I associate an exclusive resource group with or disassociate an exclusive resource group from a workspace?

If the resources in exclusive resource groups on which a data synchronization node runs are insufficient, how do I scale out the exclusive resource groups?

You need to only scale out the exclusive resource group for Data Integration for the data synchronization node.