Unsupervised Video Summarization via Iterative Training and Simplified GAN
This paper introduces a new, unsupervised method for automatic video summarization using ideas from generative adversarial networks but eliminating the discriminator, having a simple loss function, and separating training of different parts of the model. An iterative training strategy is also applied by alternately training the reconstructor and the frame selector for multiple iterations. Furthermore, a trainable mask vector is added to the model in summary generation during training and evaluation. The method also includes an unsupervised model selection algorithm. Results from experiments on two public datasets (SumMe and TVSum) and four datasets we created (Soccer, LoL, MLB, and ShortMLB) demonstrate the effectiveness of each component on the model performance, particularly the iterative training strategy. Evaluations and comparisons with the state-of-the-art methods highlight the advantages of the proposed method in performance, stability, and training efficiency.
Code (1)
Tasks
Model SelectionUnsupervised Video SummarizationVideo SummarizationSimilar Papers 제목 키워드 기반
Video Summarization using Denoising Diffusion Probabilistic Model
Video summarization aims to eliminate visual redundancy while retaining key parts of video to construct concise and comprehensive synopses. Most existing methods use discriminative models to predict the importance scores…
DenoisingmodelUnsupervised Video SummarizationVideo SummarizationSemantic-Guided Unsupervised Video Summarization
Video summarization is a crucial technique for social understanding, enabling efficient browsing of massive multimedia content and extraction of key information from social platforms. Most existing unsupervised summariza…
Unsupervised Video SummarizationUnsupervised Video Summarization With Adversarial LSTM Networks
This paper addresses the problem of unsupervised video summarization, formulated as selecting a sparse subset of video frames that optimally represent the input video. Our key idea is to learn a deep summarizer network t…
Unsupervised Video SummarizationVideo SummarizationSelf-Attention Recurrent Summarization Network with Reinforcement Learning for Video Summarization Task
With the exponential growth of video data, video summarization techniques are urgently needed for reducing people’s efforts in the videos' content exploration by generating succinct but informative summaries from origina…
reinforcement-learningReinforcement LearningSupervised Video SummarizationUnsupervised Video Summarization+1Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward
Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos. In this paper, we formulate video summarization as a sequent…
Decision MakingDeep Reinforcement LearningDiversityreinforcement-learning+6