Does Video Summarization Require Videos? Quantifying the Effectiveness of Language in Video Summarization
Video summarization remains a huge challenge in computer vision due to the size of the input videos to be summarized. We propose an efficient, language-only video summarizer that achieves competitive accuracy with high data efficiency. Using only textual captions obtained via a zero-shot approach, we train a language transformer model and forego image representations. This method allows us to perform filtration amongst the representative text vectors and condense the sequence. With our approach, we gain explainability with natural language that comes easily for human interpretation and textual summaries of the videos. An ablation study that focuses on modality and data compression shows that leveraging text modality only effectively reduces input data processing while retaining comparable results.
Code (0)
등록된 구현이 없습니다.
Tasks
Data CompressionVideo SummarizationSimilar Papers 제목 키워드 기반
Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward
Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos. In this paper, we formulate video summarization as a sequent…
Decision MakingDeep Reinforcement LearningDiversityreinforcement-learning+6Video Summarization using Deep Semantic Features
This paper presents a video summarization technique for an Internet video to provide a quick way to overview its content. This is a challenging problem because finding important or informative parts of the original video…
ClusteringVideo SummarizationProgressive Video Summarization via Multimodal Self-supervised Learning
Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-…
Self-Supervised LearningSupervised Video SummarizationVideo ClassificationVideo SummarizationLearning to Summarize Videos by Contrasting Clips
Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of vide…
Contrastive LearningUnsupervised Video SummarizationVideo SummarizationDoes SpatioTemporal information benefit Two video summarization benchmarks?
An important aspect of summarizing videos is understanding the temporal context behind each part of the video to grasp what is and is not important. Video summarization models have in recent years modeled spatio-temporal…
Activity RecognitionVideo Summarization