Papers Temporal Localization
“Temporal Localization” 태그가 달린 논문 153편 · 필터 해제
Fine-Tuning Large Audio-Language Models with LoRA for Precise Temporal Localization of Prolonged Exposure Therapy Elements
Prolonged Exposure (PE) therapy is an effective treatment for post-traumatic stress disorder (PTSD), but evaluating therapist fidelity remains labor-intensive due to the need for manual review of session recordings. We p…
Temporal LocalizationVideoMolmo: Spatio-Temporal Grounding Meets Pointing
Spatio-temporal localization is vital for precise interactions across diverse domains, from biological research to autonomous navigation and interactive interfaces. Current video-based approaches, while proficient in tra…
Autonomous DrivingAutonomous NavigationCell TrackingReferring Video Object Segmentation+4DisTime: Distribution-based Time Representation for Video Large Language Models
Despite advances in general video understanding, Video Large Language Models (Video-LLMs) face challenges in precise temporal localization due to discrete time representations and limited temporally aware datasets. Exist…
Temporal LocalizationVideo UnderstandingTransforming faces into video stories -- VideoFace2.0
Face detection and face recognition have been in the focus of vision community since the very beginnings. Inspired by the success of the original Videoface digitizer, a pioneering device that allowed users to capture vid…
Face DetectionFace RecognitionLip Readingspeech-recognition+2MINERVA: Evaluating Complex Video Reasoning
Multimodal LLMs are turning their focus to video benchmarks, however most video benchmarks only provide outcome supervision, with no intermediate or interpretable reasoning steps. This makes it challenging to assess if m…
BenchmarkingTemporal LocalizationTimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation
Soccer is a globally popular sporting event, typically characterized by long matches and distinctive highlight moments. Recent advances in Multimodal Large Language Models (MLLMs) offer promising capabilities in temporal…
Caption GenerationDense Video CaptioningLanguage ModelingLanguage Modelling+6Hierarchical and Multimodal Data for Daily Activity Understanding
Daily Activity Recordings for Artificial Intelligence (DARai, pronounced "Dahr-ree") is a multimodal, hierarchically annotated dataset constructed to understand human activities in real-world settings. DARai consists of …
Action AnticipationcounterfactualElectromyography (EMG)Sensor Fusion+1A Large-Language Model Framework for Relative Timeline Extraction from PubMed Case Reports
Timing of clinical events is central to characterization of patient trajectories, enabling analyses such as process tracing, forecasting, and causal reasoning. However, structured electronic health records capture few da…
Language ModelingLanguage ModellingLarge Language ModelTemporal LocalizationCrash Time Matters: HybridMamba for Fine-Grained Temporal Localization in Traffic Surveillance Footage
Traffic crash detection in long-form surveillance videos is critical for emergency response and infrastructure planning but remains difficult due to the brief and rare nature of crash events. We introduce HybridMamba, a …
Temporal LocalizationSocialGesture: Delving into Multi-person Gesture Understanding
Previous research in human gesture recognition has largely overlooked multi-person interactions, which are crucial for understanding the social context of naturally occurring gestures. This limitation in existing dataset…
Gesture RecognitionQuestion AnsweringTemporal LocalizationVisual Question Answering+1ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset
Traffic Atomic Activity which describes traffic patterns for topological intersection dynamics is a crucial topic for the advancement of intelligent driving systems. However, existing atomic activity datasets are collect…
Activity RecognitionTemporal LocalizationAdapting to the Unknown: Training-Free Audio-Visual Event Perception with Dynamic Thresholds
In the domain of audio-visual event perception, which focuses on the temporal localization and classification of events across distinct modalities (audio and visual), existing approaches are constrained by the vocabulary…
Temporal LocalizationVideoMind: A Chain-of-LoRA Agent for Long Video Reasoning
Videos, with their unique temporal dimension, demand precise grounded understanding, where answers are directly linked to visual, interpretable evidence. Despite significant breakthroughs in reasoning capabilities within…
Grounded Video Question AnsweringQuestion AnsweringTemporal LocalizationVideo Question Answering+2Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation
In recent years, numerous tasks have been proposed to encourage model to develop specified capability in understanding audio-visual scene, primarily categorized into temporal localization, spatial localization, spatio-te…
Data InteractionScene UnderstandingTemporal LocalizationUIEWatch and Learn: Leveraging Expert Knowledge and Language for Surgical Video Understanding
Automated surgical workflow analysis is crucial for education, research, and clinical decision-making, but the lack of annotated datasets hinders the development of accurate and comprehensive workflow analysis solutions.…
DenoisingDense Video Captioningparameter-efficient fine-tuningTemporal Localization+3Measure Twice, Cut Once: Grasping Video Structures and Event Semantics with LLMs for Video Temporal Localization
Localizing user-queried events through natural language is crucial for video understanding models. Recent methods predominantly adapt Video LLMs to generate event boundary timestamps to handle temporal localization tasks…
Temporal LocalizationVideo UnderstandingTowards Fine-Grained Video Question Answering
In the rapidly evolving domain of video understanding, Video Question Answering (VideoQA) remains a focal point. However, existing datasets exhibit gaps in temporal and spatial granularity, which consequently limits the …
Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+3TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long Videos
Temporal localization in untrimmed videos, which aims to identify specific timestamps, is crucial for video understanding but remains challenging. This task encompasses several subtasks, including temporal action localiz…
Action LocalizationBoundary DetectionChunkingGeneric Event Boundary Detection+5Weakly Supervised Multiple Instance Learning for Whale Call Detection and Temporal Localization in Long-Duration Passive Acoustic Monitoring
Marine ecosystem monitoring via Passive Acoustic Monitoring (PAM) generates vast data, but deep learning often requires precise annotations and short segments. We introduce DSMIL-LocNet, a Multiple Instance Learning fram…
Multiple Instance LearningTemporal LocalizationKnowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding
Transformer has attracted increasing interest in STVG, owing to its end-to-end pipeline and promising result. Existing Transformer-based STVG approaches often leverage a set of object queries, which are initialized simpl…
AttributeObjectSpatio-Temporal Video GroundingTemporal Localization+1