Simple Log Service and E-MapReduce (EMR) jointly launch the log delivery feature. You can use the feature to deliver logs from EMR to Simple Log Service for query and analysis. This topic describes the assets, billing, and limits of the log delivery feature.
Assets
Custom project and dedicated Logstore
You can create a custom project. After you enable log delivery, Simple Log Service creates a dedicated Logstore named
emr_EMR service name_log
in the project. For example, if you enable log delivery for the host service, the dedicated Logstore is namedemr_host_log
.ImportantBefore you disable log delivery, do not delete the related Simple Log Service project and Logstore. Otherwise, the collected logs are deleted and subsequent logs cannot be delivered to Simple Log Service.
If you have enabled the pay-by-ingested-data billing mode, Simple Log Service creates a dedicated Logstore that uses the pay-by-ingested-data billing mode by default. If you want to switch the billing mode from pay-by-ingested-data to pay-by-feature, modify the configurations of the Logstore. For more information, see Modify the configurations of a Logstore.
Dedicated dashboards
After you enable the feature, Simple Log Service does not generate dedicated dashboards. You can create a custom dashboard to visualize query results. For more information, see Create a dashboard.
Billing
You are not charged for the log delivery feature of EMR.
If the billing mode of the related Logstore is pay-by-feature, you are charged based on the storage usage, read traffic, number of requests, data transformation, and data shipping after EMR logs are delivered to Simple Log Service. For more information, see Billable items of pay-by-feature.
If the billing mode of the related Logstore is pay-by-ingested-data, you are charged based on the storage usage and read traffic over the Internet after EMR access logs are delivered to Simple Log Service. For more information, see Billable items of pay-by-ingested-data.
Limits
The log management feature is available for DataLake clusters, Dataflow clusters, OLAP clusters, DataServing clusters, and Hadoop clusters.
The log delivery feature is available for the following services: HDFS, YARN, yarn_application, Hive, Spark, JindoData, Tez, Flink, HBase, ZooKeeper, Kafka, Presto, Kudu, Impala, Flume, StarRocks, ClickHouse, Kyuubi, Remote Shuffle Service (RSS), and host.