All Products
Search
Document Center

Platform For AI:Video labeling template

Last Updated:Oct 12, 2023

iTAG of Machine Learning Platform for AI (PAI) provides a labeling template for video classification. When you create a video labeling job, you can select the labeling template based on your business scenario. This topic describes scenarios of the video labeling template and the data structures of input and output data for the template.

Video classification

Video classification is used to find one or more labels that match an input video from a set of labels and add the labels to the video. This template supports single-label and multi-label video classification.

  • Scenarios

    This labeling template applies to scenarios such as video surveillance, live streaming recommendation, and short video recommendation.

  • Data structures

    • Input data

      Each row in the .manifest file of input data contains an object. Each row must contain the source field.

      {"data":{"source":"oss://tongxin-lly.oss-cn-hangzhou.aliyuncs.com/iTAG/video/video1.mp4"}}
      ...
    • Output data

      Each row in the .manifest file of output data contains an object and the labeling results for the object. The following code provides an example on the JSON string in each row:

      { 
          "data": {
              "source": "oss://itag.oss-cn-hangzhou.aliyuncs.com/tongxin_video/video3.mp4"
          }, 
          "label-1433000711494508544": {
              "results": [
                  {
                      "questionId": "2", 
                      "data": [
                          "Label 2", 
                          "Label 1"
                      ], 
                      "markTitle": "Multiple-choice", 
                      "type": "survey/multivalue"
                  }
              ]
          }
      }