All Products
Search
Document Center

Simple Log Service:Comparison between the old and new versions of the data shipping feature for MaxCompute

Last Updated:May 30, 2024

This topic compares the old and new versions of the data shipping feature for MaxCompute. This topic also describes how to update the data shipping feature of the old version to the data shipping feature of the new version.

Comparison between the new and old versions

ItemData shipping feature for MaxCompute (old version)Data shipping feature for MaxCompute (new version)
Time range for data shippingData that is generated at and after the time when a data shipping job is created can be shipped.
  • Data that is generated at and after the time when a data shipping job is created can be shipped.
  • Historical data can be shipped.
Job quantityYou can create only one data shipping job in a Logstore to ship data to MaxCompute. You can create multiple data shipping jobs in a Logstore to ship data to MaxCompute.
MaxCompute V2.0 data type editionNot supported.Supported.
TagsNot supported.Supported.
Time zone in DateTime mappingNot supported.Supported.
DashboardNot supported.Supported.
Monitoring and alertingNot supported.Supported.
Job suspension or resumptionNot supported.Supported.
Time partition formatThe Class SimpleDateFormat format is used.The strftime format is used.
Invalid fieldNull is displayed for invalid fields.If Null is not allowed, the entire row is discarded.

Update to the new version

The old and new versions of data shipping jobs can run at the same time. You can use the same procedure to create a data shipping job of the new version and a data shipping job of the old version. To update to the new version, perform the following steps:

  1. Stop the data shipping job of the old version.
  2. Create a data shipping job of the new version.
    For more information, see Create a data shipping job of the new version to ship data to MaxCompute.
    Important When you configure the Start At parameter for a data shipping job of the new version, we recommend that you set the start time to a point in time that is 5 to 15 minutes earlier than the time when the data shipping job of the old version is stopped. The time depends on the Shipping Interval parameter in the data shipping job of the old version. This setting can help you prevent data loss but may cause a small amount of duplicate data to be shipped.

    For example, if the Shipping Interval parameter in the data shipping job of the old version is set to 1800s and you stop the job at 12:00:00 on December 20, 2021, we recommend that you set the Start At parameter in a data shipping job of the new version to 2021-12-20 11:55:00.