The IoT Platform's data service offers data parsing capabilities, allowing for the processing and transformation of device data or imported API data sources. The parsed data can be routed to business servers or stored within the IoT Platform as structured tables.
Feature description
Manage your data parsing tasks via the DataService Studio > Data Parsing page in the IoT Platform console.
Feature Item | Data Parsing | References |
Supported Data Sources | Supports parsing of both device data sources and API data sources. | |
Timeliness | Enables real-time data extraction and conversion with second-scale latency. | None |
Supported Data Formats | Supports JSON, ProtoBuf, Base64 (to_JSON), and raw data formats. | |
Billing | Data parsing tasks consume data processing units (DPUs). |
Usage instructions
Data parsing enables preprocessing of data from device and API data sources. Create data parsing tasks and utilize the data parsing workspace to configure data sources, processing methods, and output options. For detailed instructions, refer to:
Create Data Parsing Tasks.
For an overview of the data parsing workspace, see Data Parsing Workspace Description.
Configure Data Parsing:
Configure Source Nodes
Configure Data Computation and Data Filtering
(Optional) Configure Value Transformation
(Optional) Configure Data Aggregation
(Optional) Configure Timeout Interpolation
(Optional) Configure Adjacent Message Computation
Configure Target Nodes
Start Data Parsing Tasks: After configuring data parsing, you can initiate and publish the tasks.
What to do next
Once data parsing tasks are published, the preprocessed data becomes available for the following features:
Offline Data Storage
Data API
Data Metrics