Papers Temporal Localization
“Temporal Localization” 태그가 달린 논문 153편 · 필터 해제
Fusion of Millimeter-wave Radar and Pulse Oximeter Data for Low-burden Diagnosis of Obstructive Sleep Apnea-Hypopnea Syndrome
Objective: The aim of the study is to develop a novel method for improved diagnosis of obstructive sleep apnea-hypopnea syndrome (OSAHS) in clinical or home settings, with the focus on achieving diagnostic performance co…
DiagnosticSleep StagingTemporal LocalizationLLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
Recent advancements in multimodal large language models (MLLMs) have shown promising results, yet existing approaches struggle to effectively handle both temporal and spatial localization simultaneously. This challenge s…
Feature CompressionLanguage ModelingLanguage ModellingLarge Language Model+3Pseudo Strong Labels from Frame-Level Predictions for Weakly Supervised Sound Event Detection
Weakly Supervised Sound Event Detection (WSSED), which relies on audio tags without precise onset and offset times, has become prevalent due to the scarcity of strongly labeled data that includes exact temporal boundarie…
Event DetectionSound Event DetectionTemporal LocalizationDo Current Video LLMs Have Strong OCR Abilities? A Preliminary Study
With the rise of multimodal large language models, accurately extracting and understanding textual information from video content, referred to as video based optical character recognition (Video OCR), has become a crucia…
Motion DetectionOptical Character RecognitionOptical Character Recognition (OCR)Temporal LocalizationShotVL: Human-Centric Highlight Frame Retrieval via Language Queries
Existing works on human-centric video understanding typically focus on analyzing specific moment or entire videos. However, many applications require higher precision at the frame level. In this work, we propose a novel …
Human Detectionimage-classificationImage ClassificationPose Estimation+3TimeRefine: Temporal Grounding with Time Refining Video LLM
Video temporal grounding aims to localize relevant temporal boundaries in a video given a textual prompt. Recent work has focused on enabling Video LLMs to perform video temporal grounding via next-token prediction of te…
Temporal LocalizationTimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
Rapid development of large language models (LLMs) has significantly advanced multimodal large language models (LMMs), particularly in vision-language tasks. However, existing video-language models often overlook precise …
Temporal LocalizationVideo UnderstandingNumber it: Temporal Grounding Videos like Flipping Manga
Video Large Language Models (Vid-LLMs) have made remarkable advancements in comprehending video content for QA dialogue. However, they struggle to extend this visual understanding to tasks requiring precise temporal loca…
Highlight DetectionMoment RetrievalTemporal LocalizationUnsupervised detection and classification of heartbeats using the dissimilarity matrix in PCG signals
The proposed system consists of a two-stage cascade. The first stage performs a rough heartbeat detection while the second stage refines the previous one, improving the temporal localization and also classifying the hear…
Heart SegmentationSound ClassificationTemporal LocalizationDetection of Sleep Apnea-Hypopnea Events Using Millimeter-wave Radar and Pulse Oximeter
Obstructive Sleep Apnea-Hypopnea Syndrome (OSAHS) is a sleep-related breathing disorder associated with significant morbidity and mortality worldwide. The gold standard for OSAHS diagnosis, polysomnography (PSG), faces c…
Temporal LocalizationTraining-free Video Temporal Grounding using Large-scale Pre-trained Models
Video temporal grounding aims to identify video segments within untrimmed videos that are most relevant to a given natural language query. Existing video temporal localization models rely on specific datasets for trainin…
Temporal LocalizationImpact of Noisy Labels on Sound Event Detection: Deletion Errors Are More Detrimental Than Insertion Errors
This study explores the critical but underexamined impact of label noise on Sound Event Detection (SED), which requires both sound identification and precise temporal localization. We categorize label noise into deletion…
Event DetectionSound Event DetectionTemporal LocalizationDescribed Spatial-Temporal Video Detection
Detecting visual content on language expression has become an emerging topic in the community. However, in the video domain, the existing setting, i.e., spatial-temporal video grounding (STVG), is formulated to only dete…
Multi-class ClassificationTemporal LocalizationVideo GroundingMeerkat: Audio-Visual Large Language Model for Grounding in Space and Time
Leveraging Large Language Models' remarkable proficiency in text-based tasks, recent works on Multi-modal LLMs (MLLMs) extend them to other modalities like vision and audio. However, the progress in these directions has …
AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Fact CheckingLanguage ModelingLanguage Modelling+2MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval
Video Moment Retrieval (VMR) aims to localize a specific temporal segment within an untrimmed long video given a natural language query. Existing methods often suffer from inadequate training annotations, i.e., the sente…
cross-modal alignmentMoment RetrievalRetrievalSentence+1OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding
Surgical scene perception via videos is critical for advancing robotic surgery, telesurgery, and AI-assisted surgery, particularly in ophthalmology. However, the scarcity of diverse and richly annotated video datasets ha…
Action UnderstandingDiversityTemporal LocalizationLITA: Language Instructed Temporal-Localization Assistant
There has been tremendous progress in multimodal Large Language Models (LLMs). Recent works have extended these models to video input with promising instruction following capabilities. However, an important missing piece…
Instruction FollowingTemporal LocalizationText GenerationVideo-based Generative Performance Benchmarking+1Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding
Large language models (LLMs) have demonstrated remarkable capabilities in natural language and multimodal domains. By fine-tuning multimodal LLMs with temporal annotations from well-annotated datasets, e.g., dense video …
Dense Video CaptioningTemporal LocalizationVideo CaptioningVideo UnderstandingSkeleton-Based Human Action Recognition with Noisy Labels
Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and a…
Action RecognitionDenoisingMixture-of-ExpertsSkeleton Based Action Recognition+2Density-Guided Label Smoothing for Temporal Localization of Driving Actions
Temporal localization of driving actions plays a crucial role in advanced driver-assistance systems and naturalistic driving studies. However, this is a challenging task due to strict requirements for robustness, reliabi…
Action LocalizationAction RecognitionTemporal Action LocalizationTemporal Localization