Papers Highlight Detection
“Highlight Detection” 태그가 달린 논문 93편 · 필터 해제
SVHighlights: Towards Extremely Long Sport Video Highlight Detection
While highlight detection for long-form videos is of great practical importance, most existing methods remain limited to short-form content, largely due to the absence of a suitable benchmark. To bridge this gap, we intr…
Highlight DetectionTuring Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval
Video-language models are pivotal for tasks such as moment retrieval and highlight detection, yet they often struggle to capture the dynamic, non-linear interactions between temporal video sequences and textual semantics…
Saliency PredictionHighlight DetectionMoment RetrievalCoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection
Video Moment Retrieval (MR) and Highlight Detection (HD) are crucial tasks in video analysis that aim to localize specific moments and estimate clip-wise relevance based on a given text query. Recent approaches treat the…
Representation LearningHighlight DetectionMoment RetrievalVideo GroundingGroundVTS: Visual Token Sampling in Multimodal Large Language Models for Video Temporal Grounding
Video temporal grounding (VTG) is a critical task in video understanding and a key capability for extending video large language models (Vid-LLMs) to broader applications. However, existing Vid-LLMs rely on uniform frame…
Highlight DetectionMoment RetrievalFollow the Saliency: Supervised Saliency for Retrieval-augmented Dense Video Captioning
Existing retrieval-augmented approaches for Dense Video Captioning (DVC) often fail to achieve accurate temporal segmentation aligned with true event boundaries, as they rely on heuristic strategies that overlook ground …
Dense Video CaptioningHighlight DetectionSounding Highlights: Dual-Pathway Audio Encoders for Audio-Visual Video Highlight Detection
Audio-visual video highlight detection aims to automatically identify the most salient moments in videos by leveraging both visual and auditory cues. However, existing models often underutilize the audio modality, focusi…
Highlight DetectionMoment and Highlight Detection via MLLM Frame Segmentation
Detecting video moments and highlights from natural-language queries have been unified by transformer-based methods. Other works use generative Multimodal LLM (MLLM) to predict moments and/or highlights as text timestamp…
Reinforcement LearningHighlight DetectionMoment RetrievalSee, Rank, and Filter: Important Word-Aware Clip Filtering via Scene Understanding for Moment Retrieval and Highlight Detection
Video moment retrieval (MR) and highlight detection (HD) with natural language queries aim to localize relevant moments and key highlights in a video clips. However, existing methods overlook the importance of individual…
Natural Language QueriesHighlight DetectionScene UnderstandingMoment RetrievalEmpower Words: DualGround for Structured Phrase and Sentence-Level Temporal Grounding
Video Temporal Grounding (VTG) aims to localize temporal segments in long, untrimmed videos that align with a given natural language query. This task typically comprises two subtasks: Moment Retrieval (MR) and Highlight …
Highlight DetectionMoment RetrievalVideo GroundingAHA -- Predicting What Matters Next: Online Highlight Detection Without Looking Ahead
Real-time understanding of continuous video streams is essential for intelligent agents operating in high-stakes environments, including autonomous vehicles, surveillance drones, and disaster response robots. Yet, most e…
Autonomous VehiclesHighlight DetectionTest-Time Adaptation for Video Highlight Detection Using Meta-Auxiliary Learning and Cross-Modality Hallucinations
Existing video highlight detection methods, although advanced, struggle to generalize well to all test videos. These methods typically employ a generic highlight detection model for each test video, which is suboptimal a…
Test-time AdaptationHighlight DetectionTimeExpert: An Expert-Guided Video LLM for Video Temporal Grounding
Video Temporal Grounding (VTG) aims to precisely identify video event segments in response to textual queries. The outputs of VTG tasks manifest as sequences of events, each defined by precise timestamps, saliency scores…
Computational EfficiencyDense Video CaptioningHighlight DetectionMoment RetrievalMS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learning
Video Moment Retrieval (MR) and Highlight Detection (HD) aim to pinpoint specific moments and assess clip-wise relevance based on the text query. While DETR-based joint frameworks have made significant strides, there rem…
Highlight DetectionMoment RetrievalSparse-Dense Side-Tuner for efficient Video Temporal Grounding
Video Temporal Grounding (VTG) involves Moment Retrieval (MR) and Highlight Detection (HD) based on textual queries. For this, most methods rely solely on final-layer features of frozen large pre-trained backbones, limit…
parameter-efficient fine-tuningHighlight DetectionMoment RetrievalFrom Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding
The rapid growth of online video content, especially on short video platforms, has created a growing demand for efficient video editing techniques that can condense long-form videos into concise and engaging clips. Exist…
Highlight DetectionUnsupervised Transcript-assisted Video Summarization and Highlight Detection
Video consumption is a key part of daily life, but watching entire videos can be tedious. To address this, researchers have explored video summarization and highlight detection to identify key video segments. While some …
Highlight DetectionReinforcement Learning (RL)Video SummarizationRhapsody: A Dataset for Highlight Detection in Podcasts
Podcasts have become daily companions for half a billion users. Given the enormous amount of podcast content available, highlights provide a valuable signal that helps viewers get the gist of an episode and decide if the…
Binary ClassificationHighlight DetectionGameplay Highlights Generation
In this work, we enable gamers to share their gaming experience on social media by automatically generating eye-catching highlight reels from their gameplay session Our automation will save time for gamers while increasi…
Event DetectionHighlight DetectionOptical Character Recognition (OCR)Prompt Engineering+3TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models. Existing methods either compress video tokens to reduce temporal resolution,…
Dense CaptioningHighlight DetectionVideo SegmentationVideo Semantic Segmentation+1Automatic Detection of Intro and Credits in Video using CLIP and Multihead Attention
Detecting transitions between intro/credits and main content in videos is a crucial task for content segmentation, indexing, and recommendation systems. Manual annotation of such transitions is labor-intensive and error-…
CPUHighlight DetectionRecommendation SystemsVideo Summarization