This topic answers frequently asked questions about DataWorks exclusive resource groups.
Use cases for exclusive resource groups
Use cases for exclusive resource groups for scheduling
Use cases for exclusive resource groups for Data Integration
Network configurations for exclusive resource groups
What are the prerequisites for an exclusive resource group to access data in a VPC environment?
Check the network environment of a data source
Add an exclusive resource group to a whitelist
Billing and management of exclusive resource groups
Renew a resource group
Scale out, scale in, or resize a resource group
Usage of exclusive resource groups
Switch the scheduling resource group for a task
Switch the resource group for a Data Integration task
Associate or disassociate a resource group from a workspace
If a synchronization task runs out of resources, should I scale out the scheduling resource group or the data integration resource group?
Use cases for exclusive resource groups for scheduling
To access databases in a Virtual Private Cloud (VPC) environment or databases protected by a whitelist for your non-data integration tasks, use an Exclusive Resource Group for Scheduling. For more information, see Use an exclusive resource group for scheduling.
Use cases for exclusive resource groups for Data Integration
To synchronize data from a database in a VPC environment, use an Exclusive Resource Group for Data Integration. For more information, see Use an exclusive resource group for Data Integration.
Switch the resource group for scheduling
Switch the resource group for test runs in Data Studio: To switch the scheduling resource group for a test run, select Run with Parameters.
Switch the scheduling resource group for production runs:
Switch the scheduling resource group for production tasks in Data Studio
Open the Properties tab for the node. In the Resource Group section, select the desired resource group. Then, submit and deploy the node. For more information, see Configure resource properties.
Modify the scheduling resource group for the task in the Operation Center.
In the upper-left corner, click the
icon and choose . Select Auto Triggered Nodes.NoteZero-load nodes do not consume resources, so you cannot modify their scheduling resource group.
Switch the resource group for Data Integration
Switch the data integration resource group for test runs in the development environment.
In Data Studio, open an offline synchronization task and select Resource Group Configuration on the right panel.
NoteIf the production environment also needs to use this resource group, submit and deploy the node after changing the resource group.
Switch the resource group for Data Integration during a production run:
In the upper-left corner, click the
icon and choose . Select Auto Triggered Nodes.
Renew a resource group
In the DataWorks console, go to the Resource Groups page. Find the resource group that you want to renew and click Renew.
If a RAM user needs to perform these operations, see How do I grant a RAM user the permissions to purchase related services?
To change the renewal method (manual or auto-renewal), change this setting on the Alibaba Cloud renewal management page. Find the resource group by its instance name.
Scale out, scale in, or resize a resource group
You can scale out, scale in, or resize a resource group in the DataWorks console.
If a RAM user needs to perform these operations, see How do I grant a RAM user the permissions to purchase related services?
Scaling out or scaling in increases or decreases the number of nodes of the same specification within the resource group.
What are the prerequisites for an exclusive resource group to access data in a VPC environment?
To use an exclusive resource group in DataWorks to access a database, ensure the following:
When you purchase the exclusive resource group, you must select the availability zone where your data source is located and bind the resource group to a VPC.
The VPC and vSwitch bound to the exclusive resource group must be the same as the data source's VPC and vSwitch.
If the database has whitelist restrictions, add the EIP address of the exclusive resource group and the CIDR block of the VPC (or vSwitch) bound to the resource group to the database's whitelist and security group rules. For more information, see Add a whitelist and Appendix: Configure a security group for a self-managed database on an ECS instance.
Check the network environment of a data source
To check the network environment of an RDS data source:
Log on to the RDS console.
On the Instances page, click the name of the target instance.
In the navigation pane on the left, click Database Connection.
Click Switch vSwitch.
In the Switch vSwitch dialog box, view the vSwitch where the data source is located.
To check the network environment of a self-managed data source on an ECS instance:
Log on to the ECS console.
On the Instances page, click the name of the target instance.
On the Instance Details page, view the Configuration Information of the instance.
Add an exclusive resource group to a whitelist
Access over an internal network
You must add the vSwitch CIDR block of the resource group to the data source's whitelist. To find the CIDR block, go to the Resource Group page in the DataWorks Console, and select the Exclusive Resource Groups tab. Click Network Settings for the target resource group to view its vSwitch CIDR Block.
Access over the internet
Serverless resource group: Add the EIP associated with the VPC configuration of the serverless resource group to the data source's whitelist. In the Internet NAT Gateway console, find the configured SNAT entry to get the public IP address bound to the corresponding vSwitch.
Exclusive Resource Group (legacy): Add the resource group's own EIP to the data source's whitelist. On the Resource Group List page, click the Exclusive Resource Groups tab. In the Actions column for the target resource group, click Details. On the Resource Group Details page, find the EIP Address in the Basic Information section.
Associate or disassociate a resource group from a workspace
Go to the resource list page in the DataWorks Console to associate or disassociate a resource group.
You must have workspace administrator permissions to perform this operation.
If a synchronization task runs out of resources, should I scale out the scheduling resource group or the data integration resource group?
Scale out the exclusive resource group for Data Integration. You do not need to scale out the scheduling resource group.