Alibaba Cloud E-MapReduce (EMR) Serverless Spark uses the Apache Spark engine. This topic describes the engine versions and the meaning of each part in an engine version.
Engine versions and meaning of each part in an engine version
The engine version of EMR Serverless Spark is in the esr-** (Spark **, Scala **) format. Spark applications run on a standard Java Virtual Machine (JVM), and all Spark tasks are run by using Java or Scala code.
You can use vector-based technologies and native libraries in the runtime environment provided by the Alibaba Cloud Fusion engine to improve the execution performance of SQL applications. For more information about the Fusion engine, see Fusion engine.
Item | Description |
esr-** | The version number of EMR Serverless Spark. Example: esr-2.1. |
Spark ** | The version number of Apache Spark that is used by EMR Serverless Spark. Example: Spark 3.3.1. |
Scala ** | The version of the Scala programming language that is supported by the engine version. Example: Scala 2.12. |
The following table describes the available engine versions.
Engine version | Description |
esr-2.2 (Spark 3.3.1, Scala 2.12) | The engine version is built based on Apache Spark 3.3.1 and requires Scala 2.12 for programming and the Java Runtime Environment (JRE). |
esr-2.1 (Spark 3.3.1, Scala 2.12) | The engine version is built based on Apache Spark 3.3.1 and requires Scala 2.12 for programming and the JRE. |
esr-1.0 (Spark 2.4.7, Scala 2.11) | The engine version is built based on Apache Spark 2.4.7 and requires Scala 2.11 for programming and the JRE. |