All Products
Search

This Product

    Simple Log Service:Ship logs to OSS (new version)

    Document Center

    Simple Log Service:Ship logs to OSS (new version)

    Last Updated:Dec 18, 2024

    This topic compares the old and new versions of data shipping to Object Storage Service (OSS). This topic also describes how to upgrade data shipping to the new version.

    Comparison between the new and old versions

    Item

    Data shipping to OSS (old version)

    Data shipping to OSS (new version)

    Time range for data shipping

    Data that has been generated since a shipping job is created can be shipped.

    • Data that has been generated since a shipping job is created can be shipped.

    • Historical data can be shipped.

    Job quantity

    You can create only one shipping job in a Logstore.

    You can create multiple shipping jobs in a Logstore.

    Directories named with time zones

    Not supported

    Supported

    Compression type

    Snappy

    Snappy, GZIP, and ZSTD

    File format

    JSON, CSV, and Parquet

    JSON, CSV, Parquet, and ORC

    Dashboard

    Not supported

    Supported

    Monitoring and alerting

    Not supported

    Supported

    Job suspension or resumption

    Not supported

    Supported

    Shipping latency

    Not supported

    Supported

    Upgrade to the new version

    The old and new versions of data shipping to OSS can run at the same time. You can use the same procedure to create a shipping job of the new version and a shipping job of the old version. To upgrade an OSS data shipping job of the old version to the new version, perform the following steps:

    1. Stop the shipping job of the old version.

    2. Create a shipping job of the new version.

      For more information, see Create an OSS data shipping job (new version).

      Important

      When you configure the Start At parameter for a shipping job of the new version, we recommend that you set the start time to a point in time that is 5 to 15 minutes earlier than the time when you stop the shipping job of the old version. The time when the shipping job of the old version is stopped is specified by the Shipping Interval parameter in the data shipping job of the old version. This helps you prevent data loss. However, a small amount of duplicate data may be shipped.

      For example, if you set the Shipping Interval parameter in the data shipping job of the old version to 300s and you stop the job at 12:00:00 on December 20, 2021, we recommend that you set the Start At parameter in a data shipping job of the new version to 2021-12-20 11:55:00.