All Products
Search
Document Center

CloudFlow:Map states

Last Updated:Nov 26, 2024

Map states allow users to apply the same operation to each element in an array to facilitate the processing of large amounts of data and management of workflows.

Processing modes of Map states

Map states support the following processing modes to improve data processing efficiency and meet various business requirements:

  • Inline mode

    Each iteration of a Map state runs in the context of the workflow that contains the Map state. The inline mode is the default mode of Map states. For more information, see Inline mode.

  • Distributed mode

    A Map state can execute each iteration as a sub-workflow and support up to 10,000 iterations. For more information, see Distributed mode.

Differences between the inline mode and the distributed mode

Item

Inline mode

Distributed mode

Data source

Obtains data from the previous step in the workflow.

  • Obtains data from the previous step in the workflow.

  • Obtains the objects from Object Storage Service (OSS) buckets.

  • Obtains CSV files from OSS buckets.

  • Obtains inventories from OSS buckets.

  • Obtains JSON files from OSS buckets.

Iteration process

Each iteration of a Map state runs in the context of the workflow that contains the Map state.

A Map state can execute each iteration as a sub-workflow and support up to 10,000 iterations.

Max. concurrent iterations

By default, the maximum number of iterations that can be executed at the same time is 40.

By default, the maximum number of iterations that can be executed at the same time is 100. To request a quota increase, submit a ticket.

Max. iterations

By default, the maximum number of iterations has no upper limit. However, the output size of iterations is affected by the value of the Event IO Size parameter.

By default, the maximum number of iterations is 10,000. You can submit a ticket to increase the quota to 1,000,000.

Payload

The upper limit of the input payload size is 64 KB.

When you use ItemReader to read data externally, the input payload size is unlimited.