Intelligent production allows you to train digital avatars based on real humans and use text-driven or speech-driven avatars to simulate real-person broadcasting. This topic describes how to create and use custom avatars.
Overview
Before you can use a custom avatar, you must train a custom avatar.
Custom training: A real human image is used to train an algorithm to generate an avatar. This avatar can be used to generate videos without the need to record videos of real persons. If you do not have special requirements for custom avatars,.
Production: The custom avatar can be driven by text or speech to generate broadcasting videos.
The following section describes how to create a custom avatar and how to use the custom avatar to generate videos.
Create a custom avatar
Intelligent production allows you to create custom avatars. The customization plan is available in Professional Edition and General Edition. You can select an edition on your business requirements.
Professional Edition: Alibaba Cloud offers comprehensive services from recording guidance to training and fine-tuning. Professional Edition optimizes the training algorithms for individual avatars. The generated avatars are high quality and can be used in TV broadcasting and media.
General Edition: You must upload training materials. The system uses a standardized algorithm to generate custom avatars within two days. This edition allows you to generate avatars in an efficient and cost-effective manner.
Avatar customization plan | Training (video recording) method | Training material submission |
Professional Edition | Alibaba Cloud provides a professional video recording site (a studio in Hangzhou) and on-site video recording experts to ensure that you obtain the highest quality training materials during the recording. | Join the DingTalk group 48335001108 and contact customer service to create an avatar. |
General Edition (Small sample customization) | You can select the green screen or a real background to record videos. For more information about the requirements, see Guide for recording videos for custom 2D avatars. | You can submit the materials by using the following methods: 1. Submit the required materials in the Intelligent Media Services (IMS) console. 2. Submit the materials by calling an API operation. |
Before you start the recording, take note of the following requirements:
If you want the avatar to stand and sit, you must record the model in the corresponding positions and generate different avatar IDs.
To ensure the best training results, follow the Guide for recording videos for custom 2D avatars. Make sure that the model maintains natural facial expressions and avoids emotional expressions. The hands of the model cannot block his or her face.
The background of the recorded video is used in subsequent video production. If the final video that you want to create does not require the background from the recording, remove the background before you upload the video.
Use an avatar to generate videos
To create an avatar video production job by using custom avatars, you can perform the operation in the IMS console, use a web SDK, or call API operations. For more information, see Create an avatar video production job.