Meta Learning for Task-Driven Video Summarization
Existing video summarization approaches mainly concentrate on sequential or structural characteristic of video data. However, they do not pay enough attention to the video summarization task itself. In this paper, we propose a meta learning method for performing task-driven video summarization, denoted by MetaL-TDVS, to explicitly explore the video summarization mechanism among summarizing processes on different videos. Particularly, MetaL-TDVS aims to excavate the latent mechanism for summarizing video by reformulating video summarization as a meta learning problem and promote generalization ability of the trained model. MetaL-TDVS regards summarizing each video as a single task to make better use of the experience and knowledge learned from processes of summarizing other videos to summarize new ones. Furthermore, MetaL-TDVS updates models via a two-fold back propagation which forces the model optimized on one video to obtain high accuracy on another video in every training step. Extensive experiments on benchmark datasets demonstrate the superiority and better generalization ability of MetaL-TDVS against several state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Meta-LearningVideo SummarizationSimilar Papers 제목 키워드 기반
SD-VSum: A Method and Dataset for Script-Driven Video Summarization
In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the vis…
Video SummarizationSD-MVSum: Script-Driven Multimodal Video Summarization Method and Datasets
In this work, we present a method and two large-scale datasets for Script-Driven Multimodal Video Summarization. The proposed method, SD-MVSum, builds on our earlier SD-VSum method for script-driven video summarization, …
Semantic SimilarityVideo SummarizationNLP Driven Ensemble Based Automatic Subtitle Generation and Semantic Video Summarization Technique
This paper proposes an automatic subtitle generation and semantic video summarization technique. The importance of automatic video summarization is vast in the present era of big data. Video summarization helps in effici…
speech-recognitionSpeech RecognitionText SummarizationVideo SummarizationILS-SUMM: Iterated Local Search for Unsupervised Video Summarization
In recent years, there has been an increasing interest in building video summarization tools, where the goal is to automatically create a short summary of an input video that properly represents the original content. We …
Metaheuristic OptimizationUnsupervised Video SummarizationVideo SummarizationUse of Affective Visual Information for Summarization of Human-Centric Videos
Increasing volume of user-generated human-centric video content and their applications, such as video retrieval and browsing, require compact representations that are addressed by the video summarization literature. Curr…
Emotion RecognitionRetrievalSupervised Video SummarizationVideo Retrieval+1