Simple Log Service:EMR logs

Assets

• Custom project and dedicated Logstore

  You can create a custom project. After you enable log delivery, Simple Log Service creates a dedicated Logstore named emr_EMR service name_log in the project. For example, if you enable log delivery for the host service, the dedicated Logstore is named emr_host_log.

  Important

  • Before you disable log delivery, do not delete the related Simple Log Service project and Logstore. Otherwise, the collected logs are deleted and subsequent logs cannot be delivered to Simple Log Service.

  • If you have enabled the pay-by-ingested-data billing mode, Simple Log Service creates a dedicated Logstore that uses the pay-by-ingested-data billing mode by default. If you want to switch the billing mode from pay-by-ingested-data to pay-by-feature, modify the configurations of the Logstore. For more information, see Modify the configurations of a Logstore.

• Dedicated dashboards

  After you enable the feature, Simple Log Service does not generate dedicated dashboards. You can create a custom dashboard to visualize query results. For more information, see Create a dashboard.

Billing

• You are not charged for the log delivery feature of EMR.

• If the billing mode of the related Logstore is pay-by-feature, you are charged based on the storage usage, read traffic, number of requests, data transformation, and data shipping after EMR logs are delivered to Simple Log Service. For more information, see Billable items of pay-by-feature.

• If the billing mode of the related Logstore is pay-by-ingested-data, you are charged based on the storage usage and read traffic over the Internet after EMR access logs are delivered to Simple Log Service. For more information, see Billable items of pay-by-ingested-data.

Limits

• The log management feature is available for DataLake clusters, Dataflow clusters, OLAP clusters, DataServing clusters, and Hadoop clusters.

• The log delivery feature is available for the following services: HDFS, YARN, yarn_application, Hive, Spark, JindoData, Tez, Flink, HBase, ZooKeeper, Kafka, Presto, Kudu, Impala, Flume, StarRocks, ClickHouse, Kyuubi, Remote Shuffle Service (RSS), and host.