All Products
Search
Document Center

E-MapReduce:Manage resource queues

Last Updated:Jul 15, 2024

By default, each workspace contains two resource queues that are used to run jobs: dev_queue and root_queue. You can add queues to isolate resources and facilitate resource management. This topic describes the basic operations on queues.

Prerequisites

A workspace is created. For more information, see Manage workspaces.

Add a queue

Note

You can add a queue to isolate resources and facilitate resource management. If you do not add a new resource queue, you can use dev_queue and root_queue to run jobs.

  1. Go to the Queue tab.

    1. Log on to the E-MapReduce (EMR) console.

    2. In the left-side navigation pane, choose EMR Serverless > Spark.

    3. On the Spark page, click the name of the workspace that you want to manage.

    4. In the left-side navigation pane of the EMR Serverless Spark page, click Compute.

    5. On the Compute page, click the Queue tab.

  2. On the Queue tab, click Create Queue.

  3. In the Create Queue dialog box, configure the following parameters and click OK.

    Parameter

    Description

    Queue Name

    The queue name must be unique.

    Note

    After the queue is created, you cannot change the queue name.

    Maximum Concurrency

    The maximum number of concurrent compute units (CUs) that can be run for a queue. Configure this parameter based on the configuration of the compute to be deployed on the queue. Each queue requires at least 3 CUs.

    Application Environment

    • Development: The environment where developers write, test, and debug code. It includes an Integrated Development Environment (IDE), a version control system, and various debugging tools, which allow developers to build and debug software.

    • Production: The production environment that provides stable, efficient, and secure services for actual users.

Modify Maximum Concurrency

  1. On the Queue tab of the Compute page, find the queue that you want to manage and click Edit Queue in the Actions column.

  2. On the Resources tab of the Edit Queue dialog box, you can modify Maximum Concurrency.

  3. Click OK.

Edit permissions on a queue

  1. On the Queue tab of the Compute page, find the queue that you want to manage and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, click the Permissions tab.

  3. You can add, modify, or remove permissions of users.

  4. Click OK.

Delete a queue

Important
  • You cannot delete root_queue.

  • Before you delete a queue, make sure that no jobs in the workspace are associated with the queue. Otherwise, all associated jobs will be affected after the queue is deleted.

  1. On the Queue tab of the Compute page, find the queue that you want to delete and click Delete in the Actions column.

  2. In the Delete Queue dialog box, click Delete Queue.

    The default queue root_queue cannot be deleted.

References