MaxCompute:Zone-disaster recovery

Feature introduction

MaxCompute zone-disaster recovery extends the availability of data storage and computing services from a single zone to three zones in the same region and utilizes physical isolation and low-latency network connectivity of the three zones to provide real-time data synchronization and fault isolation capabilities across data centers. This prevents business systems from being interrupted due to failures in a single data center and improves the risk resistance capability of your business.

MaxCompute zone-disaster recovery includes multi-zone storage disaster recovery and multi-zone high-availability computing. The following content describes the details.

• Multi-zone storage disaster recovery: supports redundant storage of existing data in a project across three zones. Incremental data can be simultaneously written to the storage services in three zones. Before the multi-zone storage disaster recovery capability is introduced, local storage in a single zone is used for existing data in a project. When the system encounters zone-level failures, multi-zone storage disaster recovery can ensure that data read and write services are not interrupted and data is not lost. This can help you achieve a zero recovery point objective (RPO) for data.

• Multi-zone high-availability computing: binds multi-zone high-availability computing resources to a project for which storage disaster recovery is enabled to implement zone-disaster recovery for data storage and computing. You can reserve sufficient multi-zone high-availability computing resources in multiple zones. If a zone-level failure occurs, computing resources are automatically switched from the faulty zone to a zone that can normally provide services.

Disaster recovery guidelines

After zone-disaster recovery is enabled, the following recovery operations are performed when a zone-level failure occurs:

1. You are notified of the failure information from Alibaba Cloud MaxCompute.

2. The server immediately allocates computing resources from the zone that can normally provide services. The system checks the integrity and availability of data such as tables, partitions, and permissions in the project.

3. If a job that is submitted by a client fails to run, you must submit the job again. You do not need to modify the configurations for accessing MaxCompute, such as the endpoint, authentication information, project name, and quota name.

4. After the job resumes running, you must continue to monitor the upper-layer business operations to ensure that the business is properly running.

Scenarios

• Finance

  Financial services provided by banks require constant analysis and processing of business transaction data and need to prevent business interruptions caused by data center failures.

• Critical infrastructure

  Data analysis systems in industries such as power supply, water utility, and transportation need to prevent the interruptions of key information services that are critical for livelihoods of people when data centers fail.

Benefits

• Redundant data backup

• Reduced business downtime

• Compliance with industry standards

• Better upper-layer business customer experience

Limits

• Zone-disaster recovery is supported only in the China (Shenzhen), China East 2 Finance, and China (Hong Kong) regions.

• Only metadata, user permissions, package-based permissions, common tables, and Delta tables in projects support storage disaster recovery. Resources do not support storage disaster recovery.

Billing

• After storage disaster recovery is implemented, MaxCompute is billed based on the storage disaster recovery mode. For more information about the billing of storage disaster recovery, see Storage disaster recovery fee (pay-as-you-go).

• To implement multi-zone high-availability computing, you must purchase multi-zone high-availability computing resources. For more information about the billing of multi-zone high-availability computing resources, see Computing fees (subscription).

Instructions

To implement zone-disaster recovery for storage and computing, you must enable multi-zone storage disaster recovery and multi-zone high-availability computing.

Enable multi-zone storage disaster recovery

1. Log on to the MaxCompute console, and select a region in the top navigation bar.

2. In the left-side navigation pane, choose Disaster Recovery > Intra-zone Disaster Recovery Management.

3. On the Intra-zone Disaster Recovery Management page, click Enable Intra-zone Disaster Recovery.

4. In the dialog box that appears, select the MaxCompute project for which you want to implement storage disaster recovery and select the check box.

5. Click OK.

   After you enable multi-zone storage disaster recovery for a project, the system starts to prepare for storage disaster recovery for the project data. In the preparation process, the project data that is stored in a single zone is migrated to the other two zones for multi-zone storage disaster recovery. The data preparation process takes about two days. After the data preparation is complete, the project has the storage disaster recovery capability.

   Note

   • During the preparation for storage disaster recovery, the running of jobs is not affected and the business is not interrupted.

   • During the preparation for storage disaster recovery, if a task is writing data to historical table partitions in streaming mode, the preparation task does not start but waits until the streaming write operations are complete and submitted. We recommend that you write data to new partitions on a daily or weekly basis to ensure that storage disaster recovery is implemented for all tables and partitions.

   • The local backup data and time travel query data that are generated before storage disaster recovery is enabled are retained in the original zone for local storage. The local backup data and time travel query data that are generated after storage disaster recovery is enabled are distributed to three zones for redundant storage.

Enable multi-zone high-availability computing

To enable multi-zone high-availability computing, you must purchase multi-zone high-availability computing resources and configure the multi-zone high-availability computing resources in the default computing quota of the desired project.

1. Log on to the MaxCompute console, and select a region in the top navigation bar.

2. In the left-side navigation pane, choose Workspace > Quotas.

3. On the Quotas page, click New Quota.

4. On the resource purchase page, configure the parameters. The following table describes the key parameters.

   Parameter	Description
   Specifications Type	Select Multi-zone HA Computing Resource.
   Multi-zone HA CU	Select the number of compute units (CUs) that you want to purchase. Note You must purchase at least 50 CUs. If existing CUs are available, you can purchase new CUs. The number of new CUs must be an integer multiple of 1.

5. Click Buy Now. Read the terms of service and then complete the payment.

   After multi-zone high-availability computing resources are purchased, you can view the created multi-zone high-availability computing resources on the Quotas page.

6. Configure the multi-zone high-availability computing resources in the default computing quota of the desired project.

   1. In the left-side navigation pane, choose Workspace > Projects.

   2. Find the desired project, and click Manage in the Actions column.

   3. On the Parameter Configuration tab, click Edit in the Basic Information section.

   4. Set the Default Quota parameter to the multi-zone high-availability computing resources, and click Submit.

Related operations