E-MapReduce:Release notes for EMR V4.5.X

Service

Description

EMR Remote Shuffle Service (ESS)

ESS 1.0.0 is supported.

For more information, see ESS.

Hudi

Hudi 0.6.0 is supported.

Delta Lake

Delta Lake 0.6.1 is supported.

Service

Description

Ranger

• Ranger is updated to 2.1.0.

• Ownership-related permissions are supported.

Presto

• Presto is updated to 338.

• Metadata stored in Alibaba Cloud Data Lake Formation (DLF) is supported.

Zeppelin

Zeppelin is updated to 0.8.2.

SmartData

SmartData is updated to 3.1.0.

For more information, see SmartData 3.1.X.

Bigboot

Bigboot is updated to 3.1.0.

Hive

• Metadata stored in Alibaba Cloud DLF is supported.

• Ownership-related permissions of Ranger are supported.

Spark

Metadata stored in Alibaba Cloud DLF is supported.

DLF Metastore

• The issue that Presto cannot be started in a high-security cluster is fixed.

• Hive 3 and metadata cache are supported.

• The issue that occurs when you query data by using Hive or Presto is fixed.

Impala

Custom configuration of parameters on the catalogd.flgs, impalad.flgs, and statestored.flgs tabs is supported in the EMR console.

Tez

Vulnerabilities related to autoDeploy on the web UI of Tez are fixed.

OpenLDAP

A rule that determines whether port 10389 is in the waiting state is added.

Hue

Security vulnerabilities of the MySQL backend are fixed.

Kerberos

• Apache Kerby is updated to 2.0.1.

• The issue that the kadmin principal of an external Kerberos cluster cannot be customized is fixed.

Sqoop

• File formats such as Parquet, Avro, and ORC are supported.

• Metadata stored in Alibaba Cloud DLF is supported.