Diverse Sequential Subset Selection for Supervised Video Summarization
Video summarization is a challenging problem with great application potential. Whereas prior approaches, largely unsupervised in nature, focus on sampling useful frames and assembling them as summaries, we consider video summarization as a supervised subset selection problem. Our idea is to teach the system to learn from human-created summaries how to select informative and diverse subsets, so as to best meet evaluation metrics derived from human-perceived quality. To this end, we propose the sequential determinantal point process (seqDPP), a probabilistic model for diverse sequential subset selection. Our novel seqDPP heeds the inherent sequential structures in video data, thus overcoming the deficiency of the standard DPP, which treats video frames as randomly permutable items. Meanwhile, seqDPP retains the power of modeling diverse subsets, essential for summarization. Our extensive results of summarizing videos from 3 datasets demonstrate the superior performance of our method, compared to not only existing unsupervised methods but also naive applications of the standard DPP model.
Code (0)
등록된 구현이 없습니다.
Tasks
Supervised Video SummarizationVideo SummarizationSimilar Papers 제목 키워드 기반
Video Face Matching using Subset Selection and Clustering of Probabilistic Multi-Region Histograms
Balancing computational efficiency with recognition accuracy is one of the major challenges in real-world video-based face recognition. A significant design decision for any such system is whether to process and use all …
AllClusteringComputational EfficiencyFace Detection+2Subset Selection and Summarization in Sequential Data
Subset selection, which is the task of finding a small subset of representative items from a large ground set, finds numerous applications in different areas. Sequential data, including time-series and ordered data, cont…
DiversityTime SeriesTime Series AnalysisVideo SummarizationUnsupervised Procedure Learning via Joint Dynamic Summarization
We address the problem of unsupervised procedure learning from unconstrained instructional videos. Our goal is to produce a summary of the procedure key-steps and their ordering needed to perform a given task, as well as…
Procedure LearningCoRDS: Coreset-based Representative and Diverse Selection for Streaming Video Understanding
Streaming video understanding with large vision-language models (VLMs) requires a compact memory that can support future reasoning over an ever-growing visual history. A common solution is to compress the key-value (KV) …
Beyond Discrete Selection: Continuous Embedding Space Optimization for Generative Feature Selection
The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by:…
Decoderfeature selection