Cluster-based Video Summarization with Temporal Context Awareness
In this paper, we present TAC-SUM, a novel and efficient training-free approach for video summarization that addresses the limitations of existing cluster-based models by incorporating temporal context. Our method partitions the input video into temporally consecutive segments with clustering information, enabling the injection of temporal awareness into the clustering process, setting it apart from prior cluster-based summarization methods. The resulting temporal-aware clusters are then utilized to compute the final summary, using simple rules for keyframe selection and frame importance scoring. Experimental results on the SumMe dataset demonstrate the effectiveness of our proposed approach, outperforming existing unsupervised methods and achieving comparable performance to state-of-the-art supervised summarization techniques. Our source code is available for reference at \url{https://github.com/hcmus-thesis-gulu/TAC-SUM}.
Code (1)
Tasks
ClusteringUnsupervised Video SummarizationVideo SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sequential Clustering and Contextual Importance Measures for Incremental Update Summarization
Unexpected events such as accidents, natural disasters and terrorist attacks represent an information situation where it is crucial to give users access to important and non-redundant information as early as possible. In…
ClusteringTemporally Coherent Bayesian Models for Entity Discovery in Videos by Tracklet Clustering
A video can be represented as a sequence of tracklets, each spanning 10-20 frames, and associated with one entity (eg. a person). The task of \emph{Entity Discovery} in videos can be naturally posed as tracklet clusterin…
ClusteringVideo SummarizationScene Summarization: Clustering Scene Videos into Spatially Diverse Frames
We propose scene summarization as a new video-based scene understanding task. It aims to summarize a long video walkthrough of a scene into a small set of frames that are spatially diverse in the scene, which has many im…
ClusteringDiversityScene UnderstandingVideo Summarization+1Enhancing Video Summarization with Context Awareness
Video summarization is a crucial research area that aims to efficiently browse and retrieve relevant information from the vast amount of video content available today. With the exponential growth of multimedia data, the …
BenchmarkingInformativenessUnsupervised Video SummarizationVideo SummarizationDoes SpatioTemporal information benefit Two video summarization benchmarks?
An important aspect of summarizing videos is understanding the temporal context behind each part of the video to grasp what is and is not important. Video summarization models have in recent years modeled spatio-temporal…
Activity RecognitionVideo Summarization