E-MapReduce:Release notes for EMR V3.37.X

Version

Date

EMR V3.37.1

September 2021

EMR V3.37.0

August 2021

Service

Description

SmartData

SmartData is updated to 3.7.1.

Hue

The issue that Impala cannot be used in a high-security cluster is fixed.

Kudu

Kerberos is supported.

Service

Description

SmartData

SmartData is updated to 3.7.0.

Spark

The incompatibility issue between Spark and Delta Lake is fixed.

Delta Lake

• The connectors for Delta Lake are updated. This way, you can use a storage handler to create tables and query data.

• The exception that occurs when you perform an INSERT OVERWRITE operation on a partitioned table is fixed.

• The exception that occurs when you perform an OPTIMIZE operation to write virtual fields to a file in the G-SCD scenario is fixed.

YARN

• Information about app IDs, CPU utilization, and memory usage is added to the RESTful APIs of containers for nodes.

• The issue that the Application Master (AM) logs of an automatically released node cannot be viewed is fixed.

• The data of a node that is automatically released based on the decommissioning logic of auto scaling can be deleted.

• The Graceful Decommission logic of auto scaling is optimized. The node on which NodeManager runs is marked deprecated only after the NodeManager process is complete.

ZooKeeper

ZooKeeper is updated to 3.6.3.

Flink

• The SmartData service is added.

• Object Storage Service (OSS) can be accessed in password-free mode when you log on to a DataFlow-Flink cluster in SSH mode and submit a job in the cluster.

Impala

The issue that the LIST operation is repeatedly performed on directly deleted OSS partition directories is fixed.

Hue

The UI display exception that occurs when you use Hue together with Oozie is fixed.

Kudu

Kudu is updated to 1.14.0.

ClickHouse

Some default configurations are updated.