All Products
Search
Document Center

Intelligent Media Services:Introduction to intelligent production

Last Updated:Dec 09, 2024

This topic describes the features of the intelligent production service, such as video editing, live editing, the template factory, and intelligent tasks.

Video editing

Feature description

  • Provides professional online video production capabilities. You can produce videos from various auditory and visual materials, such as videos, audio, and text.
  • Supports image processing capabilities such as segmentation, stitching, cropping, and rotation.
  • Supports text-driven or voice-driven digital human broadcast capabilities.
  • Supports beautification capabilities such as transitions, filters, effects, stickers, and animated text.
  • Allows you to submit multiple tasks at a time, by using a program, or in the backend.

File source

Alibaba Cloud Object Storage Service (OSS), ApsaraVideo VOD, and local media assets are supported. Local media assets must be uploaded to OSS or ApsaraVideo VOD.

Feature trial

You can try the feature in the Intelligent Media Services (IMS) console. For more information, see Video editing.

Capabilities

Capability type

Capability

Description

Material processing

General

Number of supported material tracks

By default, 100 material tracks are supported. If you have special requirements, join the DingTalk group 48335001108 to obtain technical support.

Material type

Video, audio, image, and text materials are supported.

Material segmentation, deletion, and stitching

Supported.

Editing precision

Editing precision at the frame level is supported.

Video, audio, and image

Image preview

Supported.

Playback speed setting

Supported.

Toning

Supported.

Types of materials that support resizing and position adjustments

Video and image materials support resizing and position adjustments.

Types of materials that support cropping

Video and image materials support cropping.

Types of materials that support fade-in and fade-out

Video and audio materials support fade-in and fade-out.

Types of materials that support volume adjustments

Video and audio materials support volume adjustments.

Digital human

Drive mode

Text-driven or voice-driven digital human broadcast capabilities are supported.

Subtitle

Subtitle format

The Text, Automatic Speech Recognition (ASR), and Advanced SubStation Alpha (ASS) formats are supported.

Style settings

You can configure the font, font size, color, and word art. A custom font file is supported.

Alignment mode

Left alignment, center alignment, and right alignment are supported.

Animation effect

The following animation effects are supported: entrance effect, exit effect, and loop effect.

Beautification

Visual effect

Multiple visual effects are supported. For more information, see Sample visual effects.

Filter effect

Multiple filter effects are supported. For more information, see Sample filter effects.

Transition effect

Multiple transition effects are supported. For more information, see Sample transition effects.

Sticker effect

Multiple sticker effects are supported.

Editing and production

Definition

Resolution

A custom resolution is supported. The maximum resolution is 4K. The default resolution can be dynamically calculated based on the input materials.

Bitrate

A custom bitrate is supported. The default bitrate can be dynamically calculated based on the input materials.

Callback

N/A

The callback methods of Simple Message Queue (SMQ, formerly MNS) queues and HTTP requests are supported. You can configure callbacks for output videos. For more information, see Configure callback events.

Live editing

Feature description

  • Supports Live to VOD and live stream splitting.
  • Integrates live stream editors with regular editors. You can import live stream splitting results to a regular editor with a few clicks for fined editing.

File source

Alibaba Cloud ApsaraVideo Live is supported.

Feature trial

You can try the feature in the IMS console. For more information, see Live editing.

Capabilities

Capability

Description

Type of live streams

You can edit Alibaba Cloud live streams.

Scheduled editing

You can schedule the time when a recording starts or editing starts.

Splitting

You can configure the start time and end time of splitting. After the confirmation, the splitting is complete.

Callback

The callback method of SMQ queues is supported.

Fined editing

Fined editing for splitting results is supported. You can use video editing capabilities to implement fined editing.

Template factory

Feature description

Allows you to save your common editing methods as templates. If you use a template to edit a video, you need to only replace the dynamic materials in the template. This way, you can quickly produce a new video with similar effects. Intelligent production provides the following templates:

  • Regular template: a template that is created based on the timeline of a video editing project. Multiple materials in the timeline are overlaid and merged. A regular template can implement effects such as converting images into videos, albums, start and end parts, and the default watermark.
  • Advanced template: a template that is created based on Adobe After Effects (AE). You can configure complex animation effects in an advanced template to implement advanced media effects.

File source

Alibaba Cloud OSS, ApsaraVideo VOD, and local media assets are supported. Local media assets must be uploaded to OSS or ApsaraVideo VOD.

Feature trial

You can try the feature in the IMS console. For more information, see Template factory.

Official template and custom template

Templates are classified into regular templates and advanced templates regardless of whether they are official templates in the public template library or custom templates. For more information about the template details and usage instructions, see Online editing templates.

Capabilities

Template type

Capability

Description

Regular template

Create a template

Specify dynamic materials

Supported. Materials that are not specified as dynamic materials are fixed materials.

Specify time adaptation conditions of dynamic materials

Supported. If the duration of the replacement material is longer than the duration of the position of the dynamic material, the options of automatic splitting and postponing subsequent materials for smooth connection are supported. If the duration of the replacement material is shorter than the duration of the position of the dynamic material, the options of black frames, advancing subsequent materials for smooth connection, and mute frames at last are supported.

Specify space adaptation conditions of dynamic materials

Supported. If the size of the replacement material does not match the size of the position of the dynamic material, the options of automatic black bar addition, custom background colors, and background blurring are supported.

Preset production parameters

Supported. You can specify the default resolution and bitrate of a produced video.

Use a template

Replace dynamic materials

Supported.

Submit a template-based editing task

Supported. You can submit materials for replacing the dynamic materials and a template ID. This way, you can use the template-based editing solution to produce a new video.

Advanced template

Create a template

Create template effects

Supported. Multiple AE plug-ins are supported. You can use AE plug-ins to enrich image effects such as video transitions and effects.

Specify dynamic materials

Supported. Materials that are not specified as dynamic materials are fixed materials.

Specify dynamic materials to replace interface styles

Supported. You can configure editing groups and decorative images. If a template is used for a user-created page, intelligent production distributes editing groups and decorative images in a centralized manner.

Use a template

Replace dynamic materials

Supported.

Submit a template-based editing task

Supported. You can submit materials for replacing the dynamic materials and a template ID. This way, you can use the template-based editing solution to produce a new video.

Intelligent task

  • Feature description

    Provides intelligent tasks to help automatically produce videos from various auditory and visual materials, such as videos, audio, and text.

  • File source

    Alibaba Cloud OSS, ApsaraVideo VOD, and local media assets are supported. Local media assets must be uploaded to OSS or ApsaraVideo VOD.

Capabilities

  • Intelligent subtitling

    Voices of audio or videos can be converted into subtitle information, including text content and time information.

  • Intelligent dubbing

    Text can be converted into speeches. You can configure dubbing voices and dubbing speeds. For example, the text is "Believe it or not, I have musical talent." The following audio file uses the cute boy voice template for intelligent dubbing.

  • Image matting

    An object can be removed from a green-screen image to generate a video or an image with a transparent background.

  • Intelligent chart

    Excel tables or rule data can be used to generate a playable animated chart video. Pie charts, line charts, column charts, and custom charts are supported.