paper-with-me

홈 › Papers

ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis

2025-09-28 · Congzhi Zhang, Zhibin Wang, Yinchao Ma, Jiawei Peng, Yihan Wang, Qiang Zhou, Jun Song, Bo Zheng arxiv

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a critical data bottleneck: existing datasets lack the challenging, multi-hop questions and high-quality, video-grounded Chain-of-Thought (CoT) data necessary to effectively bootstrap RLVR. To address this, we introduce ReWatch, a large-scale dataset built to foster advanced video reasoning. We propose a novel multi-stage synthesis pipeline to synthesize its three components: ReWatch-Caption, ReWatch-QA, and ReWatch-CoT. A core innovation is our Multi-Agent ReAct framework for CoT synthesis, which simulates a human-like "re-watching" process to generate video-grounded reasoning traces by explicitly modeling information retrieval and verification. Building on this dataset, we develop ReWatch-R1 by post-training a strong baseline LVLM with Supervised Fine-Tuning (SFT) and our RLVR framework. This framework incorporates a novel Observation \& Reasoning (O\&R) reward mechanism that evaluates both the final answer's correctness and the reasoning's alignment with video content, directly penalizing hallucination. Our experiments show that ReWatch-R1 achieves state-of-the-art average performance on five challenging video reasoning benchmarks. Project Page: https://rewatch-r1.github.io

📄 PDF Abstract BibTeX arXiv:2509.23652

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningInformation Retrieval

Similar Papers 제목 키워드 기반

PerceptionComp: A Video Benchmark for Complex Perception-Centric Reasoning

2026-03-27 · Shaoxuan Li, Zhixuan Zhao, Hanze Deng, Zirun Ma 외 arxiv

We introduce PerceptionComp, a manually annotated benchmark for complex, long-horizon, perception-centric video reasoning. PerceptionComp is designed so that no single moment is sufficient: answering each question requir…

Spatial Reasoning

Video-CoM: Interactive Video Reasoning via Chain of Manipulations

2025-11-28 · Hanoona Rasheed, Mohammed Zumri, Muhammad Maaz, Ming-Hsuan Yang 외 arxiv

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static con…

Reinforcement LearningVisual Reasoning

video-SALMONN-R$^3$: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding

2026-06-23 · Yixuan Li, Guangzhi Sun, Yudong Yang, Chao Zhang arxiv

Video large language models (LLMs) are often constrained by computation and memory budgets, leading them to use reduced frame rates and spatial resolutions, which may cause them to miss critical information for question …

Reinforcement LearningQuestion Answering

ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models

2025-07-14 · Yongheng Zhang, Xu Liu, Ruihan Tao, Qiguang Chen 외 arxiv

Video understanding plays a vital role in bridging low-level visual signals with high-level cognitive reasoning, and is fundamental to applications such as autonomous driving, embodied AI, and the broader pursuit of AGI.…

Autonomous Driving

Chain-of-Anomaly Thoughts with Large Vision-Language Models

2025-12-23 · Pedro Domingos, João Pereira, Vasco Lopes, João Neves 외 arxiv

Automated video surveillance with Large Vision-Language Models is limited by their inherent bias towards normality, often failing to detect crimes. While Chain-of-Thought reasoning strategies show significant potential f…

Anomaly ClassificationAnomaly Detection