All Products
Search

This Product

    E-MapReduce:Configure connectors

    Document Center

    E-MapReduce:Configure connectors

    Last Updated:Jun 29, 2023

    This topic describes the built-in connectors provided by Presto in E-MapReduce (EMR). This topic also describes how to modify the configurations of a connector and add a custom connector in the EMR console.

    Built-in connectors of EMR Presto

    The following table describes the out-of-the-box built-in connectors that are provided by EMR Presto.

    Connector

    Description

    hive

    You can use the connector to query data in Hive data warehouses.

    kudu

    You can use the connector to query data in, insert data into, and delete data from Kudu.

    mysql

    You can use the connector to query data in tables in an external MySQL instance and create tables in the instance.

    iceberg

    You can use the connector to query data files in the Iceberg format.

    hudi

    You can use the connector to query data in Copy on Write and Merge on Read tables.

    delta

    You can use the connector to query data in Delta Lake tables.

    jmx

    You can use the connector to perform system monitoring and debugging.

    system

    You can use the connector to query the basic information and measures of Presto clusters.

    Note

    You do not need to configure the system connector. All information about the connector can be obtained from the system directory.

    Modify the configurations of a built-in connector

    You can go to the Configure tab for the Presto service in the EMR console and modify the related parameters in the configuration file of the connector that you want to modify. After the modification is complete, you need to restart the Presto service. The following table describes the mappings between connectors and configuration files.

    Connector

    Configuration file

    hive-hadoop2

    hive.properties

    kudu

    kudu.properties

    mysql

    mysql.properties

    iceberg

    iceberg.properties

    hudi

    hudi.properties

    delta

    delta.properties

    jmx

    jmx.properties

    Example: Modify the configurations of a Hive connector

    1. Go to the Configure tab of the Presto service page in the EMR console and click the hive.properties tab.

    2. Modify the configuration items based on your business requirements.

      For more information about how to modify configuration items, see Manage configuration items.

    3. After you save the configurations, choose More > Restart in the upper-right corner of the Services tab to restart the Presto service.

      Important

      After the service is restarted, the connector becomes available.

    Add a custom connector

    By default, EMR Presto provides five placeholder connectors, including connector1, connector2, connector3, connector4, and connector5. You can use these placeholder connectors to add custom connectors. You can go to the Configure tab of the Presto service page in the EMR console and configure the placeholder connectors on the connector1.properties tab, connector2.properties tab, connector3.properties tab, connector4.properties tab, and connector5.properties tab. Placeholder connectors are configured in the same way as built-in connectors.

    To add a custom connector, you need to only modify the configurations of an unoccupied placeholder connector.

    Example: Add a MongoDB connector

    1. Go to the Configure tab of the Presto service page in the EMR console and click the connector1.properties tab.

    2. Change the value of connector.name to mongodb.

    3. Add custom configuration items based on your business requirements.

      For more information about how to add custom configuration items, see Modify configuration items.

    4. After you save the configurations, choose More > Restart in the upper-right corner of the Services tab to restart the Presto service.