All Products
Search
Document Center

E-MapReduce:Manage resource queues

Last Updated:Oct 31, 2024

By default, each workspace contains two resource queues that are used to run jobs: dev_queue and root_queue. You can create queues to isolate resources and facilitate resource management. This topic describes how to manage a resource queue.

Prerequisites

A workspace is created. For more information, see Manage workspaces.

Create a resource queue

Note

You can create a resource queue to isolate resources and facilitate resource management. If you do not want to create a resource queue, you can use the dev_queue or root_queue queue to run jobs.

  1. Go to the Resources page.

    1. Log on to the E-MapReduce (EMR) console.

    2. In the left-side navigation pane, choose EMR Serverless > Spark.

    3. On the Spark page, click the name of the workspace that you want to manage.

    4. In the left-side navigation pane of the EMR Serverless Spark page, choose Operation Center > Resources.

  2. On the Queue Resources tab, click Create Queue.

  3. In the Create Queue dialog box, configure parameters and click OK. The following table describes the parameters.

    Parameter

    Description

    Queue Name

    The name of the resource queue. The name must be unique.

    Note

    After the queue is created, you cannot change the queue name.

    Maximum Concurrency

    The maximum number of concurrent compute units (CUs) that can be run for a queue. Configure this parameter based on the configuration of the session to be deployed on the queue. Each queue requires at least 3 CUs.

    Application Environment

    • Development: The environment where developers write, test, and debug code. The development environment includes an Integrated Development Environment (IDE), a version control system, and various debugging tools that are used by developers to build and debug software.

    • Production: The production environment that provides stable, efficient, and secure services for users.

Modify the maximum concurrency of the queue

  1. On the Queue Resources tab of the Resources page, find the desired queue and click Edit Queue in the Actions column.

  2. On the Resources tab of the Edit Queue dialog box, change the value of the Maximum Concurrency parameter.

  3. Click OK.

Manage permissions on a resource queue

  1. On the Queue Resources tab of the Resources page, find the desired queue and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, click the Permissions tab.

  3. On the Permissions tab, add, modify, or remove permissions for a user.

  4. Click OK.

Delete a resource queue

Important
  • You cannot delete the resource queue root_queue.

  • Before you delete a resource queue, make sure that no jobs in the workspace are associated with the queue. Otherwise, all associated jobs will be affected after the resource queue is deleted.

  1. On the Queue Resources tab of the Resources page, find the desired resource queue and click Delete in the Actions column.

  2. In the Delete Queue message, click Delete Queue.

    The default queue root_queue cannot be deleted.

References