All Products
Search
Document Center

DataWorks:Change the specifications of a resource group

Last Updated:Aug 23, 2024

If the usage of a resource group is high and a large number of tasks need to be run on the resource group in parallel, resources in the resource group may be insufficient. If this occurs, you can upgrade the specifications of the resource group. If the specifications of a resource group exceed your actual needs, you can downgrade the specifications of the resource group to reduce resource costs. This topic describes how to change the specifications of a resource group.

Overview

DataWorks allows you to upgrade or downgrade the specifications of a resource group. The following table describes the types of changes that you can apply.

Type

Description

Scope

Billing

Effective time

Upgrade

An upgrade does not increase the number of resource groups but only upgrades the specifications of resources in a resource group based on your order.

After you change the specifications of a resource group, the specifications of all resources in the resource group are changed at the same time.

You must pay for the resources that are added from the time the new configuration takes effect to the time the original order expires. You can view specific expenses in your bill in the Expenses and Costs console. For more information, see View spending details.

The new configuration takes effect about 20 minutes later after you pay for your order.

Downgrade

A downgrade does not decrease the number of resource groups but only downgrades the specifications of resources in a resource group based on your order.

You are refunded for the resources that are not used from the time the new configuration takes effect to the time the original order expires. You can view specific expenses in your bill in the Expenses and Costs console. For more information, see View spending details.

Limits

  • Limit on resource groups

    You can change the specifications of only exclusive resource groups for Data Integration that are in the Running state and exclusive resource groups for scheduling that are in the Running state.

  • Limit on permissions

    You can use only your Alibaba Cloud account or a RAM user to which the AliyunDataWorksFullAccess and AliyunBSSOrderAccess policies are attached to change the specifications of a resource group.

  • Limit on resources

    You cannot change the specifications of pay-as-you-go resources.

  • Limit on orders

    If an exclusive resource group for scheduling or an exclusive resource group for Data Integration has an unpaid scaling or specification change order, a message is displayed when you scale in or out the resource group or change the specifications of the resource group. In this case, you must go to the order center to process the order before you scale in or out the resource group or change the specifications of the resource group.

Support for specification changes of subscription resources

The following table describes the resources that support specification upgrades and downgrades. A tick (✓) indicates that the feature is supported, and a cross (×) indicates that the feature is not supported.

Resource type

Upgrade

Downgrade

Description

Exclusive resource groups for Data Integration

The specifications of each resource in an exclusive resource group for Data Integration may affect the maximum number of parallel threads that you can configure for a single data synchronization task.

If your data synchronization task requires a long period of time to synchronize large amounts of data, you can perform the following operations to accelerate the process:

  1. Upgrade the specifications of resources in your resource group and increase the maximum number of threads that can run in parallel on a single resource.

  2. Increase the maximum number of parallel threads that are configured for the synchronization task.

Exclusive resource groups for scheduling

N/A.

exclusive resource group for DataService Studio

×

N/A.

Change the specifications of a resource group

The procedure for changing the specifications of an exclusive resource group for scheduling is similar to the procedure for changing the specifications of an exclusive resource group for Data Integration. This section describes how to change the specifications of an exclusive resource group for scheduling.

  1. Go to the Resource Groups page.

    1. Log on to the DataWorks console.

    2. In the left-side navigation pane, click Resource Groups. In the top navigation bar, select a region.

  2. Change the specifications of a resource group.

    1. On the Exclusive Resource Groups tab, find the exclusive resource group for scheduling, move the pointer over the 更多 icon in the Actions column, and then select Change Specifications.

    2. Make Preparations.

      Go to the Change Specifications dialog box.

      1. In the Make Preparations step, confirm the impacts of the operations.

        Note

        Your tasks are affected when you change the specifications of a resource group. Therefore, you must read the impacts of the operations in the Make Preparations step before you perform subsequent operations.

        The following table describes the impacts of the operations.

        Impact

        Description

        Task termination

        When you change the specifications of a resource group, the system terminates all tasks that are running on the resource group. DataWorks collects the statistics about the number and types of tasks that are running on the current resource group. In the Make Preparations step, you can check whether the termination of the tasks will affect your business. In addition, you can filter tasks based on the task owner and the workspace to which the tasks belong.

        Alerting

        If alert rules are configured for the tasks that are terminated, alerts may be triggered.

        Failures for automatic rerun of some tasks

        Some terminated tasks may fail to be automatically rerun after the change is complete. For example, real-time synchronization tasks may not continue to run from the breakpoint. In this case, you must manually rerun the tasks from a specified breakpoint. For more information, see Create a real-time synchronization node to synchronize incremental data from a single table.

        Delay of tasks

        If you perform a downgrade operation, tasks are delayed.

      2. Select Yes or No for the The system reruns the terminated tasks that are in the production environment after the change is complete parameter. Then, select I am aware of the impacts of the operations.

        If you select Yes, DataWorks reruns the terminated tasks in the production environment after the change is complete. If you select No, DataWorks does not rerun the terminated tasks in the production environment after the change is complete.

        Note
        • The tasks in the production environment include real-time synchronization tasks, real-time computing tasks, auto triggered tasks, and data backfill tasks that are in the production environment of Operation Center. Test tasks that are temporarily run in DataStudio are not included.

        • Both the auto triggered tasks that are terminated by the system and the auto triggered tasks that are automatically rerun after the change generate operation records in the Cycle Instance page of Operation Center.

      3. Click Next.

    3. Configure specifications.

      Select appropriate specifications from the New Specifications drop-down list, read the terms of service, select DataWorks Exclusive Resources (Subscription) Terms of Service, and then click Pay Now.

      Note

      You can upgrade or downgrade the specifications of a resource group. The number of tasks that can be run varies based on specifications. For more information, see Exclusive resource group for scheduling overview and Exclusive resource group for Data Integration overview.

      设置规格

    4. Complete the payment.

      Click Go to Payment Page. On the Orders page, confirm the information in the Details and Order Details sections. Then, click Pay Now to complete the payment.支付

      Note

      If you cancel the payment, the specifications of the resource group are not changed. This does not affect the tasks that are running on the resource group and the resources in the resource group. If the payment fails, we recommend that you go to the order center to cancel the order. Otherwise, you cannot subsequently scale in or out the resource group or change the specifications of the resource group.

    5. Apply the change.

      After you complete the payment, DataWorks terminates all tasks that are running on the resource group. Then, DataWorks changes the specifications of the resource group. After the change is complete, the terminated tasks that are in the production environment are rerun. 执行变配The change requires some time to complete. If you accidentally close the current page, you can move the pointer over the 更多 icon in the Actions column of the resource group on the Resource Groups page and click Change Specifications to view the change progress.