All Products
Search
Document Center

E-MapReduce:Manage workflow runs and node runs

Last Updated:Jul 16, 2024

After you create a workflow, you can perform operations on existing workflow runs and node runs. This topic describes how to view a workflow run and the logs of a node.

Prerequisites

A workflow is created and run. For more information, see Manage workflows.

View the information about a workflow run

  1. Go to the Workflows page.

    1. Log on to the E-MapReduce (EMR) console.

    2. In the left-side navigation pane, choose EMR Serverless > Spark.

    3. On the Spark page, click the name of the workspace that you want to manage.

    4. In the left-side navigation pane of the EMR Serverless Spark page, click Workflows.

  2. On the Workflows page, click the name of the workflow that you want to manage.

    The Workflow Runs tab appears.

    • You can view all workflow runs, such as the time and running status of each workflow run.

    • Click the ID of a workflow run in the Workflow Run ID column of the table on the Workflow Runs tab or click the Workflow Runs Diagram tab to view the corresponding workflow run diagram. The color of a node run indicates the node running status. For more information, see View the running status.

View node runs

  1. Go to the Workflows page.

    1. Log on to the EMR console.

    2. In the left-side navigation pane, choose EMR Serverless > Spark.

    3. On the Spark page, click the name of the workspace that you want to manage.

    4. In the left-side navigation pane of the EMR Serverless Spark page, click Workflows.

  2. On the Workflows page, click the name of the workflow that you want to manage.

  3. Click the Workflow Runs Diagram tab.

  4. Click a node in the diagram. In the node information dialog box, you can perform operations or view information.image.png

    Action

    Description

    Click Details

    View the following information:

    • Job Run Information: displays the details of the node run, such as the job ID, node start time, and job run ID.

    • Execution Code: displays the job development code of the node.

    • Log: displays the job run logs.

    Click Spark UI

    Go to the Spark Jobs page, which displays the real-time information about the Spark job, such as the status, progress, and resource usage.

    Click Rerun

    Rerun the current job.

    If you select Downstream Nodes and then click Rerun, the system reruns all jobs, including those on the downstream nodes, based on the logical sequence defined in the workflow.

    Click Stop

    Stop the running node. The stopped node enters the Failed state.  

    Click Set as success

    Change the node status from Failed to Succeeded.

    If you select Downstream Nodes and then click Set as success, the system changes the status of selected failed nodes to Succeeded based on the logical sequence defined in the workflow.

    Click the link next to Job Run ID

    Go to the Overview tab on the Job History page, which displays the basic information and configurations of the job.

References

  • For information about the concepts related to workflows, see Terms.

  • For information about how to create and run workflows, see Manage workflows.