All Products
Search
Document Center

DataWorks:View the details of a monitor

Last Updated:Nov 13, 2024

The Running Records page of Data Quality displays the rule check results of monitors. After a monitor is run, you can view the details of the monitor on the Running Records page.

Go to the Running Records page

  1. Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Development and Governance > Data Quality. On the page that appears, select the desired workspace from the drop-down list and click Go to Data Quality.

  2. In the left-side navigation pane of the Data Quality page, choose Quality O&M > Running Records.

    On the Running Records page, you can specify filter conditions, such as the data source type, table name, quality check result, and whether a subscription is made, to search for the monitor that you want to view.

View a monitor

Rule Perspective

In the upper-right corner of the Running Records page, select Rule Perspective from the Perspective drop-down list.

Parameter

Description

ID/Rule Name

The ID and name of the monitoring rule.

Check Result

The quality check result. Valid values: Passed, Warning Threshold Is Exceeded, Critical Threshold Is Exceeded, Checking, and Check Failed.

  • Passed: If the quality check result meets the conditions specified in the monitoring rule, the data meets the expectation.

  • Warning Threshold Is Exceeded: The value of the metric for data quality check hits the warning threshold. In most cases, if the monitored data hits the warning threshold, exceptions are identified in the data but subsequent business operations are not affected.

  • Critical Threshold Is Exceeded: The value of the metric for data quality check hits the critical threshold. In most cases, if the monitored data hits the critical threshold, the quality check result does not meet the expectation, which will severely affect subsequent business operations.

  • Checking: The monitor is being used to check the data quality.

  • Check Failed: The monitor fails to run. For example, the monitored partition is not generated or the SQL statement used to monitor data fails to execute.

Handling Policy

The handling policy. Valid values: Alert and Block.

End Time

The time when the data check ends.

Table Name

The name of the table that is being checked.

Association Range

The data check scope. The monitoring rule can be a table-level or field-level monitoring rule.

Template

The template based on which the monitoring rule is created.

Degree of Importance

The strength of the monitoring rule.

  • Strong rules are important rules. If you set the parameter to Strong rules and the critical threshold is exceeded, the scheduling node that you associate with the monitor is blocked by default.

  • Weak rules are regular rules. If you set the parameter to Weak rules and the critical threshold is exceeded, the scheduling node that you associate with the monitor is not blocked by default.

Monitoring Threshold

The comparison method and threshold of the monitoring rule.

Details

Find the monitoring rule and click Details in the Actions column to view the running records of the rule. On the details page, you can view the details on the Running Record This Time, Historical Running Record, Problem Data Processing, and Raw Log tabs.

  • You can click the Historical Running Record tab to view the running record that is generated when the related node is scheduled each time.

  • Enter comments on a rule based on the execution status of the rule. Perform the following steps to enter comments on a rule:

    1. In the upper-right corner of the details page, click Problem Handling.

    2. In the Problem Handling dialog box, configure the Handling Method and Comments parameters.

    3. Click Confirmation.

  • You can click the Raw Log tab to view the log information of the monitoring rule.

Rules

Find the monitoring rule and click Rules in the Actions column to go to the Table Quality Details page. You can view all the rules that are associated with the monitor.

Monitor Perspective

In the upper-right corner of the Running Records page, select Monitor Perspective from the Perspective drop-down list.

任务查询

Parameter

Description

Table Name

The name of the table whose data quality you want to check based on the monitor.

Monitor

The name of the monitor.

Check Result

The quality check result of the monitor. Valid values: Passed, Warning Threshold Is Exceeded, Critical Threshold Is Exceeded, Checking, and Check Failed.

  • Passed: If the quality check result meets the conditions specified in the monitoring rule, the data meets the expectation.

  • Warning Threshold Is Exceeded: The value of the metric for data quality check hits the warning threshold. In most cases, if the monitored data hits the warning threshold, exceptions are identified in the data but subsequent business operations are not affected.

  • Critical Threshold Is Exceeded: The value of the metric for data quality check hits the critical threshold. In most cases, if the monitored data hits the critical threshold, the quality check result does not meet the expectation, which will severely affect subsequent business operations.

  • Checking: The monitor is being used to check the data quality.

  • Check Failed: The monitor fails to run. For example, the monitored partition is not generated or the SQL statement used to monitor data fails to execute.

Handling Policy

The handling policy. Valid values: Alert and Block.

Start Time

The time when the monitor starts to run.

Data Range

The partition of the table whose data quality you want to check based on the monitor.

Trigger Method

The trigger method of the monitor. Valid values: Triggered by Node Scheduling in Production Environment and Triggered Manually.

Data Timestamp

The data timestamp that corresponds to the partition specified by the Data Range parameter.

Details

Find a table and click Details in the Actions column. You can view all the rules that are associated with the monitor. You can select a rule and view the information about the rule on the Running Record This Time, Historical Running Record, Problem Data Processing, and Raw Log tabs.

  • You can click the Historical Running Record tab to view the running record that is generated when the related node is scheduled each time.

  • Enter comments on a rule based on the execution status of the rule. Perform the following steps to enter comments on a rule:

    1. In the upper-right corner of the details page, click Problem Handling.

    2. In the Problem Handling dialog box, configure the Handling Method and Comments parameters.

    3. Click Confirmation.

  • You can click the Raw Log tab to view the log information of the monitoring rule.

Rules

Find a table and click Rules in the Actions column to go to the Table Quality Details page. You can view all the rules that are associated with the monitor.

View lineage

Find a table and click View lineage in the Actions column. You are navigated to the table details page in Data Map, where you can view the lineage information.