All Products
Search
Document Center

ApsaraDB for OceanBase:Perform batch operations on data migration tasks

Last Updated:Feb 26, 2025

This topic describes how to use the data transmission service to perform batch operations on data migration tasks.

Background

The data transmission service allows you to perform batch operations on data migration tasks on the Migration Tasks page. Supported batch operations on data migration tasks vary based on the task status.

Task status

Supported batch operation

Not Configured

None

Not Started

Batch start tasks and batch modify alert configuration.

Running

Supported batch operations on running tasks vary with the scenarios.

  • Batch pause tasks and batch modify alert configuration: all scenarios.

  • Batch enter the forward switchover phase.

    Scenario: Full verification is completed for the selected tasks.

  • Batch start forward switchover.

    Scenario: The selected tasks have the same migration type and are in the same step (except the switchover precheck step) of the forward switchover phase.

  • Batch skip full verification.

    Scenario: The selected tasks have entered the full verification phase.

Modifying

Batch modify alert configuration.

Integrating

Batch modify alert configuration.

Paused

Batch restore tasks, batch stop tasks, batch modify alert configuration, and batch skip full verification in the full verification phase.

Failed

Batch restore tasks, batch stop tasks, batch modify alert configuration, and batch skip full verification in the full verification phase.

Completed

Batch stop tasks.

Stopping

None

Stopped

None

If you select multiple tasks for a batch operation while not all tasks support this batch operation, a dialog box appears and displays the tasks that support this batch operation.

image

Go to the Migration Tasks page

  1. Log on to the ApsaraDB for OceanBase console.

  2. In the left-side navigation pane, choose Data Transmission > Data Migration. The Migration Tasks page automatically appears.

    You can select data migration tasks for a batch operation.

    image.png

Batch pause tasks

The data transmission service allows you to batch pause data migration tasks in the Running state.

  1. On the Migration Tasks page, select the data migration tasks to be paused.

  2. Click Batch Pause in the lower part of the page.

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that support batch pausing, the task names, and the latest timestamps.

    image.png

  4. After the operation succeeds, the number of tasks that are successfully paused is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch restore tasks

The data transmission service allows you to batch restore data migration tasks in the Paused or Failed state.

  1. On the Migration Tasks page, select the data migration tasks to be restored.

  2. Click Batch Restore in the lower part of the page.

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that support batch restoration, the task names, and the latest timestamps.

    image.png

  4. After the operation succeeds, the number of tasks that are successfully restored is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch stop tasks

The data transmission service allows you to batch stop data migration tasks in the Paused, Failed, or Completed state.

  1. On the Migration Tasks page, select the data migration tasks to stop.

  2. Click Batch Stop in the lower part of the page.

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that support batch stop, the task names, and the latest timestamps.

    image.png

  4. After the operation succeeds, the number of tasks that are successfully stopped is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch start forward switchover

The data transmission service allows you to batch start forward switchover on data migration tasks that are in the Running state and in the same step (except the switchover precheck step) of forward switchover.

Forward switchover consists of the following steps: start forward switchover, perform switchover precheck, start the target Store, confirm that writing has stopped in the source, confirm the writing stop timestamp upon synchronization completion, stop forward synchronization, process database objects, and start reverse incremental synchronization.

Note

The steps of forward switchover vary with the migration types specified when you created the task.

  1. On the Migration Tasks page, select the data migration tasks for which you want to batch start forward switchover.

  2. Click Batch Start Forward Switchover in the lower part of the page.

    image

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that support this batch operation, the task names, and the latest timestamps.

    image..png

  4. In the Batch Start Forward Switchover dialog box, perform operations as prompted.

    1. Start forward switchover.

      You can click Confirm Start in the upper-right corner of the Start Forward Switchover section to batch start forward switchover for multiple tasks. You can also click Start next to a task to start forward switchover for a single task.

      image..png

    2. Perform switchover precheck.

      The precheck in this step checks whether the task is ready for a switchover. If the task passes the precheck, the system automatically performs the next step. If the precheck fails, the system shows the error details.

      image..png

      In this case, you can retry or skip the precheck. After you click Skip, you need to click Skip again in the dialog box that appears.

    3. Start the target Store.

      Start incremental data pulling in the target database. Create and start a target Store task. If the start fails, you can choose to click Retry or Skip.

      image..png

    4. Confirm that writing has stopped in the source database.

      You can click Confirm in the upper-right corner of the Confirm Writing Stopped at Source section to batch start this substep for multiple tasks. You can also click Confirm next to a task to start this substep for a single task.

      image..png

    5. Confirm the writing stop timestamp upon synchronization completion.

      The data transmission service automatically checks whether the source and target databases are synchronized to the same timestamp. After the check is completed, the latency and timestamp of the incremental synchronization are displayed. If the synchronization of incremental data failed, you can click Retry or Skip.

      image..png

    6. Stop forward synchronization.

      You can stop the incremental synchronization from the source database to the target database. If the forward synchronization fails to be stopped, you can choose to click Retry or Skip.

      image..png

    7. Process database objects.

      You can click Mark as Completed in the upper-right corner of the Process Database Objects section to start batch processing multiple database objects. You can also click Mark as Completed next to a task to start this substep for a single task. After all tasks have been marked as completed, proceed to the next step.

      image..png

    8. Start reverse incremental synchronization.

      You can click Confirm Start in the upper-right corner of the Start Reverse Incremental Migration section to batch start incremental writes from the target to the source. You can also click Start next to a task to start this substep for a single task. Wait until the Reverse incremental synchronization started message appears.

      image..png

Batch start tasks

The data transmission service allows you to batch start data migration tasks in the Not Started state.

  1. On the Migration Tasks page, select the data migration tasks to start.

  2. Choose More Batch Operations > Batch Start in the lower part of the page.

    image..png

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that support batch start, the task names, and the latest timestamps.

    image..png

  4. After the operation succeeds, the number of tasks that are successfully started is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch enter the forward switchover phase.

The data transmission service allows you to enable multiple data migration tasks that are in the Running state and that have completed full verification to enter the forward switchover phase.

image.png

  1. On the Migration Tasks page, select the data migration tasks to enter the forward switchover phase.

  2. Choose More Batch Operations > Batch Enter Forward Switchover in the lower part of the page.

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks that can enter the forward switchover phase, the task names, and the latest timestamps.

  4. After the operation succeeds, the number of tasks that succeeded in the batch operation is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch modify alert configuration

The data transmission service allows you to batch modify alert configuration of data migration tasks in the Not Started, Running, Modifying, Integrating, Paused, or Failed state.

  1. On the Migration Tasks page, select the data migration tasks whose alert configuration is to be modified.

  2. Choose More Batch Operations > Batch Modify Alert Configuration in the lower part of the page.

    image.png

  3. In the Batch Configure Alerts dialog box, set the related parameters

    On the Migration Tasks page, you can check whether alert configuration is completed for a specific task. If alert configuration is not specified for a task, you can choose whether to enable Task Status Monitoring or Incremental Latency Monitoring based on your business needs. You can also modify the alert configuration of a task.

    Important

    The new configuration will overwrite the existing configuration of the selected tasks. Proceed with caution.

    image

    Type

    Parameter

    Description

    Enable Task Status Monitoring

    Alert Rules

    An alert is triggered if an exception is detected in the task.

    The rules apply to all exceptions that occur during the starting and running of the following processes: precheck, schema migration, full migration, incremental migration, and incremental synchronization.

    Alerting Frequency

    The interval for sending alerts, in seconds. Value range: 60 to 604800 (seven days).

    Alert Method

    The alert notification method. Valid values are DingTalk, Lark, and Alibaba Cloud CMS external alarm address.

    Alert URL

    The URL of the corresponding alert chatbot. For more information, see Configure an alert URL.

    Remarks (Optional)

    Additional information about the alert URL.

    Enable Incremental Latency Monitoring

    Incremental Latency

    The alerting threshold of the incremental synchronization latency.

    If the incremental synchronization latency of a data migration task exceeds the specified threshold, an alert is triggered.

    Alerting Frequency

    The interval for sending alerts, in seconds. Value range: 60 to 604800 (seven days).

    Alert Method

    The alert notification method. Valid values are DingTalk, Lark, and Alibaba Cloud CMS external alarm address.

    Alert URL

    The URL of the corresponding alert chatbot. For more information, see Configure an alert URL.

    Remarks (Optional)

    Additional information about the alert URL.

  4. Click Submit.

    You can also click Submit and Test to test whether an alert can be properly sent. Alerts are sent to the recipients by using the notification methods specified in the CloudMonitor console.

    To view the alerts generated for a data migration or synchronization task, see View task alerts.

  5. After the alert configuration is modified for the selected tasks, a prompt is displayed on the page. For any task that failed the batch operation, troubleshoot the issue as prompted.

Batch skip full verification

The data transmission service allows you to batch skip full verification for data migration tasks that are in the Running, Paused, or Failed state in the full verification phase.

image.png

  1. On the Migration Tasks page, select the data migration tasks to skip full verification.

  2. Choose More Batch Operations > Batch Skip Full Verification in the lower part of the page.

  3. In the dialog box that appears, click OK.

    This dialog box displays the number of tasks for which full verification can be skipped, the task names, and the latest timestamps.

  4. After the operation succeeds, the number of tasks that succeeded in the batch operation is displayed.

    For any task that failed the batch operation, troubleshoot the issue as prompted.