The Migration Assistant service of DataWorks allows you to migrate data objects across different DataWorks versions, Alibaba Cloud accounts, regions, or workspaces.
Migration Assistant allows you to export data objects in your workspace, including auto triggered nodes, manually triggered nodes, resources, functions, data sources, table metadata, ad hoc queries, and script templates. You can create full export tasks, incremental export tasks, or custom export tasks to export your data objects in DataWorks based on your business requirements.
Limits
DataWorks of all editions allows you to migrate the tasks of open source scheduling engines such as Oozie, Azkaban, and Airflow to the cloud. The Migration Assistant service of DataWorks in different editions provides different migration policies, as described in the following table.
Item | Basic Edition | Standard Edition | Professional Edition | Enterprise Edition |
Item | Basic Edition | Standard Edition | Professional Edition | Enterprise Edition |
Maximum number of packages that can be exported for free within a tenant | Cumulative quantity: 10 | Cumulative quantity: 30 | Cumulative quantity: 100 | No upper limit |
Maximum size of a package that you want to import | 100M | 300M | No upper limit | No upper limit |
Support for automatic commit and deployment during data import | No | No | Yes | Yes |
To create export or import tasks, you must use an Alibaba Cloud account or be the workspace administrator. If you use a RAM user that is not assigned the administrator role, you can only view export and import tasks.
Precautions
The Migration Assistant service of DataWorks does not allow you to migrate data. You can use the batch synchronization feature to migrate data. For more information, see Overview of the batch synchronization feature.
Use scenarios
Back up node code
You can use Migration Assistant to back up your node code to prevent data from being deleted by mistake. In this case, we recommend that you create a full export task.
Export a common workflow for replication
You can use Migration Assistant to export a common workflow that can be replicated in other workspaces. In this case, we recommend that you create a custom export task.
Build a test environment
You can use Migration Assistant to copy all node code and replace production data with test data to build a test environment. In this case, we recommend that you create a full or custom export task.
Develop data in a hybrid cloud environment
You can use Migration Assistant to migrate node code from Alibaba Cloud public cloud to Alibaba Cloud Apsara Stack to develop data in a hybrid cloud environment. In this case, we recommend that you create a custom export task.
Migrate data objects between the development and production environments
If the production environment of your workspace is completely isolated from the development environment of the workspace, you can use Migration Assistant to export nodes from the development environment and import them to the production environment for deployment.