Simple Log Service now features an improved MaxCompute shipping capability that supports data shipping from the moment the task is created and includes the shipping of historical data. You can create multiple MaxCompute shipping tasks within a logstore.
Upgrade to the new version
Both the old and new versions of data shipping jobs can operate concurrently. The process for creating a data shipping job is the same for both versions. To upgrade to the new version, simply terminate the MaxCompute shipping task of the old version and create a task of the new version. For more information, see Create a data shipping job of the new version to ship data to MaxCompute.
When you configure the Start At parameter for a shipping job of the new version, we recommend that you set the start time to a point in time that is 5 to 15 minutes earlier than the time when you stop the shipping job of the old version. The time when the shipping job of the old version is stopped is specified by the Shipping Interval parameter in the data shipping job of the old version. This helps you prevent data loss. However, a small amount of duplicate data may be shipped.
For example, if you set the Shipping Interval parameter in the data shipping job of the old version to 300 seconds and you stop the job at 12:00:00 on December 20, 2023, we recommend that you set the Start At parameter in a data shipping job of the new version to 2023-12-20 11:55:00.
Comparison between the new and old versions
Item | Data shipping to MaxCompute (old version) | Data shipping to MaxCompute (new version) |
Time range for data shipping | Supports data shipping starting from the creation of the MaxCompute shipping task. |
|
Number of tasks | Only one MaxCompute shipping task can be created in a logstore. | Multiple MaxCompute shipping tasks can be created in a logstore. |
Not supported | Supported | |
Tags | Not supported | Supported |
Time zone in DateTime mapping | Not supported | Supported |
Dashboard | Not supported | Supported |
Monitoring and alerting | Not supported | Supported |
Job suspension or resumption | Not supported | Supported |
Time partition format | Uses Class SimpleDateFormat format | Uses strftime format |
Invalid field | Null is displayed for invalid fields. | If Null is not allowed, the entire row is discarded. |