All Products
Search
Document Center

DataWorks:Scale out or in a resource group

Last Updated:Sep 10, 2024

If the usage of a resource group is high and a large number of tasks need to be run on the resource group in parallel, resources in the resource group may be insufficient. If this occurs, you can scale out the resource group. If a resource group is idle for an extended period of time, you can scale in the resource group to reduce resource costs. This topic describes how to scale out or in a resource group.

Overview

The following table describes the types of scaling operations that you can perform.

Operation

Description

Memory and network

Billing

Remarks

Effective time

Scale out a resource group

A scale-out increases the number of resources with the same specifications in a resource group.

  • A scale-out does not upgrade the CPU and memory specifications of the resources.

  • A scale-out does not increase the number of virtual private clouds (VPCs) with which your resource group is associated.

You need to pay for the added resources of the period from the time the new configuration takes effect to the time the original order expires. You can view specific expenses in your bill in the Expenses and Costs console. For more information, see View spending details.

You can scale out a resource group without the need to stop the tasks that are running on the resource group.

The new configuration takes effect approximately 30 minutes after you pay for your order.

Scale in a resource group

A scale-in decreases the number of resources with the same specifications in a resource group.

N/A.

You are refunded for the removed resources of the period from the time the new configuration takes effect to the time the original order expires. You can view specific expenses in your bill in the Expenses and Costs console. For more information, see View spending details.

You can scale in a resource group only after you stop the tasks that are running on the resource group.

Limits

  • Limits on resource groups

    • You can scale only exclusive resource groups for Data Integration and exclusive resource groups for scheduling.

    • You can scale only resource groups that are in the Running state.

  • Limit on permissions

    You can use only a RAM user to which the AliyunDataWorksFullAccess and AliyunBSSOrderAccess policies are attached to scale a resource group.

Precautions

After you scale a resource group, the elastic IP address (EIP) of the resource group changes. To ensure the connectivity between the resource group and data sources, you must view the new EIP of the resource group and add the EIP to the whitelists of the data sources.查看独享资源组EIP

Scale out a resource group

The procedure for scaling out an exclusive resource group for scheduling is similar to the procedure for scaling out an exclusive resource group for Data Integration. This section describes how to scale out an exclusive resource group for scheduling.

  1. Go to the Resource Groups page.

    1. Log on to the DataWorks console.

    2. In the left-side navigation pane, click Resource Groups. In the top navigation bar, select a region.

  2. On the Exclusive Resource Groups tab, find the desired exclusive resource group, move the pointer over the 更多 icon in the Actions column, and then select Scale Out.

  3. On the Upgrade/Downgrade page, configure the Units parameter, read the terms of service, and then select Terms of Service.

    Note
    • If you want a resource group to access a data source that is configured with an IP address whitelist, you must add the IP address or Classless Inter-Domain Routing (CIDR) block of the resource group to the IP address whitelist. For more information, see Configure an IP address whitelist.

    • A scale-out only increases the number of resources in a resource group.

  4. Click Buy Now.

    Note
    • In most cases, a large number of users perform scale-out operations from 00:00 to 08:00 every day. If you scale out your resource group during this period of time, the scale-out may be prolonged for 1 to 2 hours.

    • A scale-out in the following regions requires a longer period of time to complete: China (Hong Kong), Singapore, Indonesia (Jakarta), US (Silicon Valley), US (Virginia), Germany (Frankfurt), UK (London), Japan (Tokyo), Malaysia (Kuala Lumpur), and UAE (Dubai).

    • On the Resource Groups page, you can move the pointer over the status of the resource group to view the scale-out progress.扩容进度

    • After the scale-out is complete, you can click Details in the Actions column of the resource group to view the number of resources in the resource group.

Scale in a resource group

The procedure for scaling in an exclusive resource group for scheduling is similar to the procedure for scaling in an exclusive resource group for Data Integration. This section describes how to scale in an exclusive resource group for scheduling.

Note

If you scale in your resource group, the tasks on the resource group may be delayed. Before you scale in a resource group, you must evaluate the impact of the scale-in operation on your business.

  1. Go to the Resource Groups page.

    1. Log on to the DataWorks console.

    2. In the left-side navigation pane, click Resource Groups. In the top navigation bar, select a region.

  2. On the Exclusive Resource Groups tab, find the desired exclusive resource group, move the pointer over the 更多 icon in the Actions column, and then click Scale In.

  3. On the Downgrade page, configure the Units parameter, read the terms of service, and then select Terms of Service.

    Note
    • A scale-in only decreases the number of resources in a resource group.

    • If your resource group has only one resource, you cannot scale in the resource group.

  4. Click Buy Now.

    • On the Resource Groups page, you can move the pointer over the status of the resource group to view the scale-in progress.

    • After the scale-in is complete, you can click Details in the Actions column of the resource group to view the number of resources in the resource group.