Overview of Tencent Multi-modal Ads Video Understanding Challenge

2021-09-16 · Zhenzhi Wang, Liyu Wu, Zhimin Li, Jiangfeng Xiong, Qinglin Lu

Multi-modal Ads Video Understanding Challenge is the first grand challenge aiming to comprehensively understand ads videos. Our challenge includes two tasks: video structuring in the temporal dimension and multi-modal video classification. It asks the participants to accurately predict both the scene boundaries and the multi-label categories of each scene based on a fine-grained and ads-related category hierarchy. Therefore, our task has four distinguishing features from previous ones: ads domain, multi-modal information, temporal segmentation, and multi-label classification. It will advance the foundation of ads video understanding and have a significant impact on many ads applications like video recommendation. This paper presents an overview of our challenge, including the background of ads videos, an elaborate description of task and dataset, evaluation protocol, and our proposed baseline. By ablating the key components of our baseline, we would like to reveal the main challenges of this task and provide useful guidance for future research of this area. In this paper, we give an extended version of our challenge overview. The dataset will be publicly available at https://algo.qq.com/.

📄 PDF Abstract BibTeX arXiv:2109.07951

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Video ClassificationVideo Understanding

Tencent-MVSE: A Large-Scale Benchmark Dataset for Multi-Modal Video Similarity Evaluation

2022-01-01 · CVPR 2022 1 · Zhaoyang Zeng, Yongsheng Luo, Zhenhua Liu, Fengyun Rao 외

Multi-modal video similarity evaluation is important for video recommendation systems such as video de-duplication, relevance matching, ranking, and diversity control. However, there still lacks a benchmark dataset t…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Diversity Recommendation Systems+3

Tencent AVS: A Holistic Ads Video Dataset for Multi-modal Scene Segmentation

2022-12-09 · Jie Jiang, Zhimin Li, Jiangfeng Xiong, Rongwei Quan 외

Temporal video segmentation and classification have been advanced greatly by public benchmarks in recent years. However, such research still mainly focuses on human actions, failing to describe videos in a holistic view.…

Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Scene Segmentation Segmentation+2

Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations

2022-04-07 · Jie Jiang, Shaobo Min, Weijie Kong, Dihong Gong 외

Text-Video Retrieval plays an important role in multi-modal understanding and has attracted increasing attention in recent years. Most existing methods focus on constructing contrastive pairs between whole videos and com…

Contrastive Learning Denoising Retrieval Sentence+2

Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation

2026-07-07 · Shenxi Liu, Kan Li, Mingyang Zhao, Yuhang Tian 외 arxiv

Following the CMIVQA, MMI-VQA, and M4IVQA challenges in NLPCC 2023--2025, we introduce the Difficulty-Aware Medical Instructional Video Question Answering (DA-MIVQA) shared task for NLPCC 2026. DA-MIVQA extends previous …

Video Question Answering Visual Grounding

Video Ads Content Structuring by Combining Scene Confidence Prediction and Tagging

2021-08-20 · Tomoyuki Suzuki, Antonio Tejero-de-Pablos

Video ads segmentation and tagging is a challenging task due to two main reasons: (1) the video scene structure is complex and (2) it includes multiple modalities (e.g., visual, audio, text.). While previous work focuses…

TAG