paper-with-me

Papers

UniversalVTG: A Universal and Lightweight Foundation Model for Video Temporal Grounding

2026-04-09 · Joungbin An, Agrim Jain, Kristen Grauman arxiv

Video temporal grounding (VTG) is typically tackled with dataset-specific models that transfer poorly across domains and query styles. Recent efforts to overcome this limitation have adapted large multimodal language models (MLLMs) to VTG, but their high compute cost and limited video context still hinder long-video grounding. We instead scale unified supervision while keeping the model lightweight. We present UniversalVTG, a single VTG model trained with large-scale cross-dataset pretraining. An offline Query Unifier canonicalizes heterogeneous query formats into a shared declarative space, reducing linguistic mismatch and preventing the negative transfer observed under naïve joint training. Combined with an efficient grounding head, UniversalVTG scales to long, untrimmed videos. Across diverse benchmarks-GoalStep-StepGrounding, Ego4D-NLQ, TACoS, Charades-STA, and ActivityNet-Captions-one UniversalVTG checkpoint achieves state-of-the-art performance versus dedicated VTG models. Moreover, despite being $>100\times$ smaller than recent MLLM-based approaches, UniversalVTG matches or exceeds their accuracy on multiple benchmarks, offering a practical alternative to parameter-heavy MLLMs.

📄 PDF Abstract BibTeX arXiv:2604.08522

Code (0)

등록된 구현이 없습니다.

Tasks

Video Grounding

Similar Papers 제목 키워드 기반

Towards Data-Efficient Video Pre-training with Frozen Image Foundation Models

2026-05-18 · Svetlana Orlova, Niccolò Cavagnero, Gijs Dubbelman arxiv

Video foundation models achieve strong performance across many video understanding tasks, but typically require large-scale pre-training on massive video datasets, resulting in substantial data and compute costs. In cont…

InternVQA: Advancing Compressed Video Quality Assessment with Distilling Large Foundation Model

2025-02-26 · Fengbin Guan, Zihao Yu, Yiting Lu, Xin Li 외

Video quality assessment tasks rely heavily on the rich features required for video understanding, such as semantic information, texture, and temporal motion. The existing video foundational model, InternVideo2, has demo…

Video Quality AssessmentVideo Understanding

SurgMotion: A Video-Native Foundation Model for Universal Understanding of Surgical Videos

2026-02-05 · Jinlin Wu, Felix Holm, Chuxi Chen, An Wang 외 arxiv

While foundation models have advanced surgical video analysis, current approaches rely predominantly on pixel-level reconstruction objectives that waste model capacity on low-level visual details, such as smoke, specular…

Action Triplet RecognitionPolyp SegmentationDepth Estimation

ResidualViT for Efficient Temporally Dense Video Encoding

2025-09-16 · Mattia Soldan, Fabian Caba Heilbron, Bernard Ghanem, Josef Sivic 외 arxiv

Several video understanding tasks, such as natural language temporal video grounding, temporal activity localization, and audio description generation, require "temporally dense" reasoning over frames sampled at high tem…

Video Grounding

Data-Efficient Surgical Phase Segmentation in Small-Incision Cataract Surgery: A Controlled Study of Vision Foundation Models

2026-04-12 · Lincoln Spencer, Song Wang, Chen Chen arxiv

Surgical phase segmentation is central to computer-assisted surgery, yet robust models remain difficult to develop when labeled surgical videos are scarce. We study data-efficient phase segmentation for manual small-inci…