GraphTMT: Unsupervised Graph-based Topic Modeling from Video Transcripts
To unfold the tremendous amount of multimedia data uploaded daily to social media platforms, effective topic modeling techniques are needed. Existing work tends to apply topic models on written text datasets. In this paper, we propose a topic extractor on video transcripts. Exploiting neural word embeddings through graph-based clustering, we aim to improve usability and semantic coherence. Unlike most topic models, this approach works without knowing the true number of topics, which is important when no such assumption can or should be made. Experimental results on the real-life multimodal dataset MuSe-CaR demonstrates that our approach GraphTMT extracts coherent and meaningful topics and outperforms baseline methods. Furthermore, we successfully demonstrate the applicability of our approach on the popular Citysearch corpus.
Code (1)
Tasks
ClusteringTopic ModelsWord EmbeddingsSimilar Papers 제목 키워드 기반
Multimodal Fusion and Coherence Modeling for Video Topic Segmentation
The video topic segmentation (VTS) task segments videos into intelligible, non-overlapping topics, facilitating efficient comprehension of video content and quick access to specific content. VTS is also critical to vario…
Contrastive LearningMixture-of-ExpertsScene SegmentationSegmentation+1Hierarchical Graph Topic Modeling with Topic Tree-based Transformer
Textual documents are commonly connected in a hierarchical graph structure where a central document links to others with an exponentially growing connectivity. Though Hyperbolic Graph Neural Networks (HGNNs) excel at cap…
SpecificityTopic ModelsSumGraph: Video Summarization via Recursive Graph Modeling
The goal of video summarization is to select keyframes that are visually diverse and can represent a whole story of an input video. State-of-the-art approaches for video summarization have mostly regarded the task as a f…
Video SummarizationTime-sync Video Tag Extraction Using Semantic Association Graph
Time-sync comments reveal a new way of extracting the online video tags. However, such time-sync comments have lots of noises due to users' diverse comments, introducing great challenges for accurate and fast video tag e…
TAGVisTopics: A Visual Semantic Unsupervised Approach to Topic Modeling of Video and Image Data
Understanding visual narratives is crucial for examining the evolving dynamics of media representation. This study introduces VisTopics, a computational framework designed to analyze large-scale visual datasets through a…