paper-with-me

Papers

TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs

2025-12-16 · Jun Zhang, Teng Wang, Yuying Ge, Yixiao Ge, Xinhao Li, Ying Shan, Limin Wang arxiv

This paper does not introduce a novel method but instead establishes a straightforward, incremental, yet essential baseline for video temporal grounding (VTG), a core capability in video understanding. While multimodal large language models (MLLMs) excel at various video understanding tasks, the recipes for optimizing them for VTG remain under-explored. In this paper, we present TimeLens, a systematic investigation into building MLLMs with strong VTG ability, along two primary dimensions: data quality and algorithmic design. We first expose critical quality issues in existing VTG benchmarks and introduce TimeLens-Bench, comprising meticulously re-annotated versions of three popular benchmarks with strict quality criteria. Our analysis reveals dramatic model re-rankings compared to legacy benchmarks, confirming the unreliability of prior evaluation standards. We also address noisy training data through an automated re-annotation pipeline, yielding TimeLens-100K, a large-scale, high-quality training dataset. Building on our data foundation, we conduct in-depth explorations of algorithmic design principles, yielding a series of meaningful insights and effective yet efficient practices. These include interleaved textual encoding for time representation, a thinking-free reinforcement learning with verifiable rewards (RLVR) approach as the training paradigm, and carefully designed recipes for RLVR training. These efforts culminate in TimeLens models, a family of MLLMs with state-of-the-art VTG performance among open-source models and even surpass proprietary models such as GPT-5 and Gemini-2.5-Flash. All codes, data, and models will be released to facilitate future research.

📄 PDF Abstract BibTeX arXiv:2512.14698

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs

2026-07-19 · Yuhan Zhu, Changlian Ma, Xiangyu Zeng, Xinhao Li 외 hf

Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs. We study generalist video temporal grounding, in which one model predicts a va…

MLLMs Know When Before Speaking: Revealing and Recovering Temporal Grounding via Attention Cues

2026-05-21 · Dazhao Du, Liao Duan, Jian Liu, Tao Han 외 arxiv

Video temporal grounding (VTG), which localizes the start and end times of a queried event in an untrimmed video, is a key test of whether multimodal large language models (MLLMs) understand not only what happens but als…

Kwai Keye-VL-2.0 Technical Report

2026-06-09 · Kwai Keye Team, Bin Wen, Changyi Liu, Chengru Song 외 arxiv

We introduce Kwai Keye-VL-2.0-30B-A3B, an open-source Mixture-of-Experts (MoE) multimodal foundation model designed to advance long-video understanding and agentic intelligence. To address the challenges of ultra-long co…

Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding

2026-08-28 · Hanoona Rasheed, Haania Siddiqui, Ming-Hsuan Yang, Fahad Shahbaz Khan 외 arxiv

Spatio-temporal video grounding (STVG) requires models to identify when a referred event occurs and localize the target entity throughout that interval. Existing multimodal large language models typically serialize dense…

Spatio-Temporal Video GroundingVideo Object Tracking

VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

2024-11-07 · Shehan Munasinghe, Hanan Gani, Wenqi Zhu, Jiale Cao 외

Fine-grained alignment between videos and text is challenging due to complex spatial and temporal dynamics in videos. Existing video-based Large Multimodal Models (LMMs) handle basic conversations but struggle with preci…

DecoderLanguage ModelingLanguage ModellingLarge Language Model+3