paper-with-me

홈 › Papers

Cluster-based Video Summarization with Temporal Context Awareness

2024-04-06 · Hai-Dang Huynh-Lam, Ngoc-Phuong Ho-Thi, Minh-Triet Tran, Trung-Nghia Le

In this paper, we present TAC-SUM, a novel and efficient training-free approach for video summarization that addresses the limitations of existing cluster-based models by incorporating temporal context. Our method partitions the input video into temporally consecutive segments with clustering information, enabling the injection of temporal awareness into the clustering process, setting it apart from prior cluster-based summarization methods. The resulting temporal-aware clusters are then utilized to compute the final summary, using simple rules for keyframe selection and frame importance scoring. Experimental results on the SumMe dataset demonstrate the effectiveness of our proposed approach, outperforming existing unsupervised methods and achieving comparable performance to state-of-the-art supervised summarization techniques. Our source code is available for reference at \url{https://github.com/hcmus-thesis-gulu/TAC-SUM}.

📄 PDF Abstract BibTeX arXiv:2404.04511

Code (1)

hcmus-thesis-gulu/tac-sum 공식 구현

Tasks

ClusteringUnsupervised Video SummarizationVideo Summarization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Multi-Head Attention 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Sequential Clustering and Contextual Importance Measures for Incremental Update Summarization

2016-12-01 · COLING 2016 12 · Markus Zopf, Eneldo Loza Menc{\'\i}a, Johannes F{\"u}rnkranz

Unexpected events such as accidents, natural disasters and terrorist attacks represent an information situation where it is crucial to give users access to important and non-redundant information as early as possible. In…

Clustering

Temporally Coherent Bayesian Models for Entity Discovery in Videos by Tracklet Clustering

2014-09-22 · Adway Mitra, Soma Biswas, Chiranjib Bhattacharyya

A video can be represented as a sequence of tracklets, each spanning 10-20 frames, and associated with one entity (eg. a person). The task of \emph{Entity Discovery} in videos can be naturally posed as tracklet clusterin…

ClusteringVideo Summarization

Scene Summarization: Clustering Scene Videos into Spatially Diverse Frames

2023-11-28 · Chao Chen, Mingzhi Zhu, Ankush Pratap Singh, Yu Yan 외

We propose scene summarization as a new video-based scene understanding task. It aims to summarize a long video walkthrough of a scene into a small set of frames that are spatially diverse in the scene, which has many im…

ClusteringDiversityScene UnderstandingVideo Summarization+1

Enhancing Video Summarization with Context Awareness

2024-04-06 · Hai-Dang Huynh-Lam, Ngoc-Phuong Ho-Thi, Minh-Triet Tran, Trung-Nghia Le

Video summarization is a crucial research area that aims to efficiently browse and retrieve relevant information from the vast amount of video content available today. With the exponential growth of multimedia data, the …

BenchmarkingInformativenessUnsupervised Video SummarizationVideo Summarization

Does SpatioTemporal information benefit Two video summarization benchmarks?

2024-10-04 · Aashutosh Ganesh, Mirela Popa, Daan Odijk, Nava Tintarev

An important aspect of summarizing videos is understanding the temporal context behind each part of the video to grasp what is and is not important. Video summarization models have in recent years modeled spatio-temporal…

Activity RecognitionVideo Summarization