AI-assisted content moderation - ApsaraVideo VOD - Alibaba Cloud Documentation Center

The automated review feature is implemented based on a large amount of labeled data and deep learning algorithms. This feature reviews media files from multiple dimensions such as voice, text, and image. This feature can accurately identify illegal and non-compliant content such as pornographic, terrorist, and politically sensitive content in videos and the corresponding thumbnails and titles. This feature is widely used in short video review and media review scenarios. This topic describes how to create a custom review template and perform automated reviews.

Scenarios

UGC review
The automated review feature can be used to detect illegal content and quality issues in a large amount of user-generated content (UGC). This can reduce the workload of manual review.
Content review for on-demand videos
The automated review feature can be used to detect terrorist and politically sensitive content in on-demand videos based on the political news. This can significantly reduce illegal content.

Review types

Review type	Description	Category of review results
Pornography	Detects whether media files contain pornographic or sexy content.	Normal, porn, and sexy
Terrorist and politically sensitive content	Detects whether media files contain terrorist or politically sensitive content.	Normal, blood and gore, explosion, special outfit, special logo, weapon, politics, violence, crowd, parade, car crash, flag, and location
Ad	Detects whether video and image files contain ads or illegal text.	Normal, politics, porn, abuse, terrorism, prohibited content, junk content, spam, illegal ads, QR code, mini program code, and other ads
Undesirable content	Detects whether video and image files contain undesirable scenes, such as the black screen, black bars, dark images, picture-in-picture (PiP), smoking, or streaming during driving.	Normal, PiP, smoking, streaming during driving, and no image such as black screen or white screen
Logo	Detects whether video and image files contain logos, such as controlled media logos or trademarks.	Normal, controlled logo, and trademark
Audio anti-spam	Detects whether audio and video files contain junk audio information, such as ads, politically sensitive content, or terrorist content.	Normal, junk information, ads, politics, terrorism, abuse, porn, spam, violation, meaningless, and custom such as custom keywords

Billing

You are charged for the total duration of reviewed videos. To view billing details, submit a ticket. For more information, see Contact us.

Usage notes

The automated review feature is available only in the China (Shanghai), China (Beijing), and Singapore regions.
Only Illicit Content Identification, Violence, and Undesirable Content Detection are available in the Singapore region.
The final review result of an audio or video file is determined by the results of automated review and manual review. If the results of automated review and manual review are different, the manual review result takes precedence over the automated review result.
Only audio and video files in the Normal state can be played on other platforms. You can play audio and video files in the Blocked or Reviewing state only by using the ApsaraVideo VOD console or IP addresses in review security groups described in Security IP address preview. However, unauthorized users can play the audio or video files if the playback URLs are leaked. You cannot call API operations or use SDKs to obtain the playback URLs of audio or video files that are in the Blocked or Reviewing state.

Prerequisites

ApsaraVideo VOD is activated. For more information, see Activate ApsaraVideo VOD.
The media files that you want to review are uploaded to the media asset library in ApsaraVideo VOD. For more information, see Overview.

How to use the automated review feature

Step 1: (Optional) Configure an automated review template

ApsaraVideo VOD provides a built-in automated review template as the default template. You can also create a custom automated review template based on your business requirements.

Note

You cannot change the configurations of the built-in automated review template or delete the template. The following content describes the configurations:
- Review Type: Violence and Illicit Content Identification
- Review Scope: Video, Cover, and Name
- Review Content: Image
You can create up to 20 custom automated review templates.

Use the ApsaraVideo VOD console

Log on to the ApsaraVideo VOD console.
In the left-side navigation pane, choose Review Management > Settings.

Create an automated review template.

On the Review Settings page, click the Review Template tab.

On the page that appears, click Add Template. The following table describes the parameters.

Parameter	Description
Template Name	The name of the template. You can use template names to differentiate different templates.
Review Type	The review type. You can select multiple review types. Valid values: Illicit Content Identification Violence Ad Detection Logo Detection Undesirable Content Detection Audio Anti-spam Note If you want to review audio files, select Audio Anti-spam. Only Illicit Content Identification, Violence, and Undesirable Content Detection are available in the Singapore region.
Review Scope	The review scope of the video. You can select multiple options. Valid values: Cover: reviews the thumbnail of the video. Name: reviews the name of the video. Video: reviews the content of the video. Note You can review up to five thumbnails. The name and the live comments of the video cannot exceed 128 bytes. The duration of the video cannot exceed 6 hours.
Review Content	Only images can be reviewed.
Auto Block	If you enable this feature, videos that contain violations are automatically blocked and cannot be played. The violations are determined by the automated review template that you configured. Important The auto block feature may cause high risks. Proceed with caution.

Click Save.

Specify the default automated review template.
- Method 1: On the Review Template tab, find the automated review template that you want to use as the default one and click Set as Default in the Actions column.
- Method 2: On the Review Configuration tab, click Modify in the Automated Review section. In the Automated Review Configuration dialog box, select the automated review template that you want to use as the default one from the Review Template drop-down list and click OK.

Use the ApsaraVideo VOD API

Call the AddAITemplate operation to create an automated review template.
Call the SetDefaultAITemplate operation to specify the default automated review template.

For more information about how to modify, query, and delete an automated review template, see AI templates.

Step 2: (Optional) Configure event notifications

Before you submit an automated review job, we recommend that you configure event notifications. This allows you to obtain the status and review result of the automated review job from the returned callback message. For more information about how to configure event notifications, see Configure callbacks.

The following content describes the events related to automated review for which you can configure notifications:

Video Analysis Completed. You can call the SubmitAIMediaAuditJob operation to submit a review job only after the VideoAnalysisComplete event is triggered.
AI Processing Completed. The AIMediaAuditComplete event is triggered every time an AI processing job is complete.

Step 3: Submit an automated review job

You can use a workflow to automatically submit an automated review job for an audio or video file that is being uploaded. Alternatively, you can submit an automated review job after the file is uploaded.

Use the ApsaraVideo VOD console

Scenario 1: Submit an automated review job for a file that is being uploaded

Create a workflow that contains an automated review node.
Add an automated review node in the workflow and specify the built-in default template or the custom template that you created in Step 1: (Optional) Configure an automated review template. For more information about how to create a workflow, see Manage workflows.
Upload files by using the workflow.
1. Log on to the ApsaraVideo VOD console. In the left-side navigation pane, choose Media Files > Audio/Video.
2. On the Video and Audio page, click Upload. On the Upload Media page, click Add Media.
3. In the Add Media dialog box, specify the upload method and storage address, add the file that you want to upload, and select Use Workflow from the drop-down list. Then, select the workflow that contains an automated review node from the drop-down list.
4. Click Upload.

Scenario 2: Submit an automated review job for an uploaded file

Method 1: Submit an automated review job on the Video and Audio page
1. Create a workflow that contains an automated review node.
  Add an automated review node in the workflow and specify the built-in default template or the custom template that you created in Step 1: (Optional) Configure an automated review template. For more information about how to create a workflow, see Manage workflows.
2. Use a workflow to submit an automated review job on the Video and Audio page.
  1. Log on to the ApsaraVideo VOD console. In the left-side navigation pane, choose Media Files > Audio/Video.
  2. On the Video and Audio page, find the file that you want to manage and click Media Processing in the Actions column.
  3. In the Media Processing dialog box, set Processing Type to Use Workflow and Transcoding Template Group to the workflow that contains the automated review node.
  4. Click OK.
Method 2: Submit an automated review job on the Content Moderation page
1. Log on to the ApsaraVideo VOD console.
2. In the left-side navigation pane, choose Review Management > Content Moderation.
3. On the Content Moderation page, select the audio or video file that needs to be reviewed.
  You can select ALL or Custom Time from the drop-down list and select Media ID or Video Title from the drop-down list to filter media files.
4. Start the automated review.
  - If the audio or video file is not reviewed, find the file and click Automated Review in the Actions column. Then, the system performs an automated review based on the automated review template that you specified in Step 1. Not Reviewed is displayed in the Automated Review Status column for an audio or video file that is not reviewed.
  - If you want to perform an automated review on an audio or video file that is reviewed, find the file and click Re-review in the Actions column. Then, the system performs an automated review based on the automated review template that you specified in Step 1. Review Failed or Passed is displayed in the Automated Review Status column for an audio or video file that is reviewed.

Use the ApsaraVideo VOD API

Scenario 1: Submit an automated review job for a file that is being uploaded

Create a workflow that contains an automated review node.
Add an automated review node in the workflow and specify the built-in default template or the custom template that you created in Step 1: (Optional) Configure an automated review template. For more information about how to create a workflow, see Manage workflows.
Call the following operations to upload a media file. Set WorkflowId to the ID of the workflow that contains the automated review node and configure the request parameters based on your business requirements.
- CreateUploadVideo
- UploadMediaByURL

Scenario 2: Submit an automated review job for an uploaded file

Set the TemplateId parameter to the automated review template that you want to use when you call an API operation to submit an automated review job. If you leave the TemplateId parameter empty, the default automated review template that you specified in Step 1 is used.

Audio and video files: Call the SubmitAIMediaAuditJob operation to submit an automated review job.
Image files: Call the SubmitAIImageAuditJob operation to submit an automated review job.
Note
The following limits apply when you call the API operation to submit an automated review job for an image.
- The size of each image cannot exceed 20 MB, the height or width of the image cannot exceed 30,000 pixels, and the total number of pixels of the image cannot exceed 250 million.
- We recommend that you do not submit images smaller than 256 × 256 pixels. Otherwise, the review performance may be compromised.

Step 4: View the review results

Note

The image resources in the automated review results are stored in ApsaraVideo VOD for two weeks free of charge. Image resources that are stored for more than two weeks are automatically deleted.
If you have configured event notifications, you can obtain the automated review result from the AIMediaAuditComplete callback.

Use the ApsaraVideo VOD console

Log on to the ApsaraVideo VOD console.
In the left-side navigation pane, choose Review Management > Content Moderation.

On the Content Moderation page, view the automated review result.

You can obtain automated review results from the following parameters: Automated Review Status, Review Template, Automated Review Result, and Violations. The following table describes the parameters.

Parameter	Description
Video	The name, ID, and storage address of the audio or video file.
Automated Review Status	The status of automated review. Valid values: Not Reviewed: The audio or video file is not reviewed. Passed: The review is complete. In this case, Violation, Suspected, or Normal is displayed in the Automated Review Result column. Review Failed: The review failed. In this case, the template that is used in the automated review is displayed in the Review Template column and -- is displayed in the Automated Review Result column. Reviewing: The audio or video file is being reviewed for the first time. Re-reviewing: The audio or video is being re-reviewed.
Review Template	The template that is used in the automated review. You can specify a template by performing the operations described in Step1: (Optional) Configure an automated review template.
Automated Review Result	The result of the automated review. Valid values: Violations: The audio or video file contains violations that are specified in the automated review template. The violations are displayed in the Violation column. Suspected: The audio or video file may contain violations that are specified in the automated review template. The violations are displayed in the Violation column. We recommend that you perform a manual review on the audio or video file. Normal: The audio or video file does not contain violations that are specified in the automated review template. In this case, normal is displayed in the Violation column. --: The audio or video file is not reviewed or fails to be reviewed.
Violation	The violations detected by the automated review. Valid values: Porn, Terrorism, Ad, Logo, Undesirable Content, Audio, Normal, and --. -- indicates that the audio or video file is not reviewed.
Human Review Status	The status of manual review. Valid values: Not Reviewed: No manual review is performed on the audio or video file. In this case, -- is displayed in the Final Review Result column. Reviewed: The audio or video is manually reviewed. In this case, Passed or Blocked is displayed in the Final Review Result column.
Final Review Result	The final review result of the audio or video file. Valid values: Passed: The audio or video file can be played. Blocked: The audio or video file can be played only by using the ApsaraVideo VOD console or IP addresses in review security groups. However, unauthorized users can play the file if the playback URL is leaked. You cannot call API operations or use SDKs to obtain the playback URLs of audio or video files that are in the Blocked state. --: The audio or video file is not reviewed. To determine whether the file can be played, perform the following operations: Log on to the ApsaraVideo VOD console. In the left-side navigation pane, choose Media Files > Audio/Video. On the page that appears, check whether the status of the file is Normal.
Actions	The action that you can perform on the audio or video file. Three options are available: Details, Re-review, and Manual Review.

View the review details of the audio or video file.
Find the audio or video file and click Details in the Actions column. On the Video review details page, you can preview the content of the audio or video file, obtain the file name and ID, and view the automated review result and manual review result. You can also play the audio or video file to determine the result of manual review.

Use the ApsaraVideo VOD API

Call the GetAIMediaAuditJob operation to query the details of an automated review job.
Call the GetMediaAuditResultDetail operation to query the automated review results of an audio, video, or image file.

For more information about API operations related to automated review jobs and results, see Automated review.