paper-with-me

Papers

VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice

2026-01-08 · Shuming Liu, Mingchen Zhuge, Changsheng Zhao, Jun Chen, Lemeng Wu, Zechun Liu, Chenchen Zhu, Zhipeng Cai, Chong Zhou, Haozhe Liu, Ernie Chang, Saksham Suri, Hongyu Xu, Qi Qian, Wei Wen, Balakrishnan Varadarajan, Zhuang Liu, Hu Xu, Florian Bordes, Raghuraman Krishnamoorthi, Bernard Ghanem, Vikas Chandra, Yunyang Xiong arxiv

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for multimodal large language models on video understanding tasks. However, its necessity and advantages over direct answering remain underexplored. In this paper, we first demonstrate that for RL-trained video models, direct answering often matches or even surpasses CoT performance, despite CoT producing step-by-step analyses at a higher computational cost. Motivated by this, we propose VideoAuto-R1, a video understanding framework that adopts a reason-when-necessary strategy. During training, our approach follows a Thinking Once, Answering Twice paradigm: the model first generates an initial answer, then performs reasoning, and finally outputs a reviewed answer. Both answers are supervised via verifiable rewards. During inference, the model uses the confidence score of the initial answer to determine whether to proceed with reasoning. Across video QA and grounding benchmarks, VideoAuto-R1 achieves state-of-the-art accuracy with significantly improved efficiency, reducing the average response length by ~3.3x, e.g., from 149 to just 44 tokens. Moreover, we observe a low rate of thinking-mode activation on perception-oriented tasks, but a higher rate on reasoning-intensive tasks. This suggests that explicit language-based reasoning is generally beneficial but not always necessary.

📄 PDF Abstract BibTeX arXiv:2601.05175

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation

2024-11-20 · CVPR 2025 1 · Ziyang Luo, HaoNing Wu, Dongxu Li, Jing Ma 외

Large multimodal models (LMMs) with advanced video analysis capabilities have recently garnered significant attention. However, most evaluations rely on traditional methods like multiple-choice questions in benchmarks su…

ChatbotMultiple-choiceUser SimulationVideo Understanding

Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning

2025-10-27 · Shijian Wang, Jiarui Jin, Xingjian Wang, Linxin Song 외 arxiv

Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been…

Reinforcement Learning

Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling

2026-02-02 · Andong Chen, Wenxin Zhu, Qiuyu Ding, Yuchen Song 외 arxiv

Chain-of-Thought reasoning has driven large language models to extend from thinking with text to thinking with images and videos. However, different modalities still have clear limitations: static images struggle to repr…

Long-Context UnderstandingMultimodal ReasoningVisual StorytellingVisual Reasoning

Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneously

2026-03-12 · Yiran Guan, Liang Yin, Dingkang Liang, Jianzhong Ju 외 arxiv

Online Video Large Language Models (VideoLLMs) play a critical role in supporting responsive, real-time interaction. Existing methods focus on streaming perception, lacking a synchronized logical reasoning stream. Howeve…

Logical ReasoningKnowledge Graphs

Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm

2025-11-06 · Jingqi Tong, Yurong Mou, Hangcheng Li, Mingzhe Li 외 arxiv

The "Thinking with Text" and "Thinking with Images" paradigms significantly improve the reasoning abilities of large language models (LLMs) and Vision-Language Models (VLMs). However, these paradigms have inherent limita…

Multimodal ReasoningVideo Generation