DataWorks:Exclusive resource group mode

In exclusive resource group mode, physical resources such as the networks, disks, CPU, and memory are completely exclusive. The exclusive resource group mode has the following features:

• Resources of different users are isolated.

• Resources that are used to run nodes in different workspaces are isolated.

• Exclusive resources can be scaled in or out. You can use and flexibly configure exclusive resources.

You can purchase DataWorks exclusive resources based on the subscription billing method. To purchase exclusive resources, you can go to the product page or open the Create a dedicated resource group panel.

• Go to the product page

• Open the Create a dedicated resource group panel

  1. Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, click Resource Group.

  2. On the Exclusive Resource Groups tab of the Resource Groups page, click Create Resource Group for Scheduling of Old Version or Create Resource Group for Data Integration of Old Version.

After you create an exclusive resource group, you can view its basic information, such as the expiration time, resource quantity, and resource usage, in the exclusive resource group list.

• Expiration Time: the time when the exclusive resource group expires. The expiration time is determined based on the duration that you specify when you placed the related order.

  • You can renew an exclusive resource group before it expires. If an exclusive resource group is not renewed after it expires, the exclusive resource group is in the Expired state and cannot be used for new nodes.

  • You can activate an expired exclusive resource group within seven days after it expires. If you do not activate an exclusive resource group within seven days after it expires, it is released.

• Groups: the quantity of resources that you purchased.

• Resource Group Usage: the usage of the resources in the exclusive resource group in percentage.

After you create an exclusive resource group, you can manage it in the exclusive resource group list. For example, you can scale out, scale in, or renew the exclusive resource group, configure network settings, or change the workspace to which the exclusive resource group belongs.

• Scale out

  If the resource usage of an exclusive resource group is excessively high or fails to meet your business requirements, find the resource group in the exclusive resource group list, move the pointer over the More icon in the Actions column, and then click Scale Out to purchase more resources for the resource group.

• Scale in

  If resources in an exclusive resource group are sometimes idle, find the resource group in the exclusive resource group list, move the pointer over the More icon in the Actions column, and then click Scale In to decrease the quantity of resources in the resource group.

• Renew

  To extend the validity period of an exclusive resource group, find the resource group in the exclusive resource group list, move the pointer over the More icon in the Actions column, and then click Renew.

• Configure networks settings

  Exclusive resource groups are deployed in virtual private clouds (VPCs) that are managed by DataWorks. If you want to establish a network connection between an exclusive resource group and a data source that resides in your own VPC, you must associate the exclusive resource group with the VPC.

  1. Find the exclusive resource group in the exclusive resource group list and click Network Settings in the Actions column to associate the resource group with a VPC on the VPC Binding tab.

     Before the association, authorize DataWorks to access your cloud resources in the RAM console.

  2. After the authorization is complete, click Add VPC Association.

  3. In the Add VPC Association dialog box, configure the parameters based on your business requirements.

     Important

     You must associate the exclusive resource group with the VPC in which the required data source resides or with the VPC to which the data source is connected.

     If you want to use an exclusive resource group to access a data source in a data center or access a data source across Alibaba Cloud accounts or regions, you must associate the exclusive resource group with the VPC to which the data source is connected. For more information, see Create and use an exclusive resource group for Data Integration. You must also add a custom route for the exclusive resource group. For more information, see General reference: Add a route.

  If some information changes after the association, find the association record for the exclusive resource group on the VPC Binding tab and click Unbind in the Actions column to disassociate the exclusive resource group from the VPC. Then, you can associate the exclusive resource group with the VPC again.

• Change the workspace

  You must associate an exclusive resource group with a workspace so that the exclusive resource group can be used by nodes in the workspace. You can associate an exclusive resource group with multiple workspaces.

• Change specifications

  If the specifications of an exclusive resource group cannot meet your business requirements, find the resource group in the exclusive resource group list, move the pointer over the More icon in the Actions column, and then click Change Specifications. In the Change Specifications dialog box, change the specifications. For information about available specifications of resource groups, see the Performance metrics section in the "Billing of exclusive resource groups for scheduling (subscription)" topic and the Performance metrics section in the "Billing of exclusive resource groups for Data Integration (subscription)" topic.

  Note

  When you change the specifications, you change server resources for the resource group. After the payment is complete, if node instances are running on the resource group, they are listed in the Stop Node Instance step. Click Stop Now in the Actions column of the required node instances to stop the node instances, or change the specifications after the node instances finish running. Otherwise, you cannot change the specifications of the resource group.

Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration.

• Exclusive resource group for scheduling

  1. Go to the DataStudio page.

     Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Development and Governance > Data Development. On the page that appears, select the desired workspace from the drop-down list and click Go to Data Development.

  2. On the DataStudio page, double-click the required node. The node configuration tab appears.

  3. Click the Properties tab in the right-side navigation pane.

  4. In the Resource Group section, select a resource group from the Resource Group drop-down list.

• Exclusive resource group for Data Integration

  After you create an exclusive resource group for Data Integration, you can select it when you configure a data synchronization node of Data Integration.

  1. On the Exclusive Resource Groups tab of the Resource Groups page, find the required exclusive resource group for Data Integration and click Associate Workspace in the Actions column. Then, associate the exclusive resource group for Data Integration with a workspace.

  2. On the configuration tab of a batch synchronization node, configure scheduling properties, test the node, and then select the resource group that you want to use to run the node.

     1. Click the icon in the upper-left corner and choose All Products > Data Development And Task Operation > DataStudio. Then, switch to the workspace with which the exclusive resource group for Data Integration is associated.

     2. In the Scheduled Workflow pane of the DataStudio page, double-click the required node to go to the node configuration tab.

     3. Click the Configure Resource Group for Data Integration tab in the right-side pane.

     4. On the Configure Resource Group for Data Integration tab, select the desired resource group type and resource group.

     5. In the top toolbar of the configuration tab of the node, click the icon.