paper-with-me

홈 › Papers

When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning

2025-05-21 · Xiaoyun Zhang, Jingqing Ruan, Xing Ma, Yawen Zhu, Haodong Zhao, Hao Li, Jiansong Chen, Ke Zeng, Xunliang Cai

Large reasoning models (LRMs) achieve remarkable performance via long reasoning chains, but often incur excessive computational overhead due to redundant reasoning, especially on simple tasks. In this work, we systematically quantify the upper bounds of LRMs under both Long-Thinking and No-Thinking modes, and uncover the phenomenon of "Internal Self-Recovery Mechanism" where models implicitly supplement reasoning during answer generation. Building on this insight, we propose Adaptive Self-Recovery Reasoning (ASRR), a framework that suppresses unnecessary reasoning and enables implicit recovery. By introducing accuracy-aware length reward regulation, ASRR adaptively allocates reasoning effort according to problem difficulty, achieving high efficiency with negligible performance sacrifice. Experiments across multiple benchmarks and models show that, compared with GRPO, ASRR reduces reasoning budget by up to 32.5% (1.5B) and 25.7% (7B) with minimal accuracy loss (1.2% and 0.6% pass@1), and significantly boosts harmless rates on safety benchmarks (up to +21.7%). Our results highlight the potential of ASRR for enabling efficient, adaptive, and safer reasoning in LRMs.

📄 PDF Abstract BibTeX arXiv:2505.15400

Code (0)

등록된 구현이 없습니다.

Tasks

Answer Generation

Similar Papers 제목 키워드 기반

A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education

2024-10-11 · Ehsan Latif, Yifan Zhou, Shuchen Guo, Yizhu Gao 외

As artificial intelligence (AI) continues to advance, it demonstrates capabilities comparable to human intelligence, with significant potential to transform education and workforce development. This study evaluates OpenA…

Logical Reasoning

When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning

2025-05-21 · Rongzhi Zhu, Yi Liu, Zequn Sun, Yiwei Wang 외

Large reasoning models (LRMs) have significantly advanced performance on complex tasks, yet their tendency to overthink introduces inefficiencies. This study investigates the internal mechanisms of reinforcement learning…

Reinforcement Learning (RL)

Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning

2025-03-20 · Ming Li, Jike Zhong, Shitian Zhao, Yuxiang Lai 외

This paper investigates the role of explicit thinking process in rule-based reinforcement fine-tuning (RFT) for MLLMs. We first propose CLS-RL for MLLM image classification, using verifiable rewards for fine-tuning. Expe…

ClassificationFew-Shot Learningimage-classificationImage Classification+3

S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images

2026-04-23 · Qingxiao Li, Lifeng Xu, QingLi Wang, Yudong Bai 외 arxiv

We present S1-VL, a multimodal reasoning model for scientific domains that natively supports two complementary reasoning paradigms: Scientific Reasoning, which relies on structured chain-of-thought, and Thinking-with-Ima…

Reinforcement LearningMultimodal Reasoning

Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Models

2026-06-16 · Zihao Wei, Wenjie Shi, Liang Pang, Jingcheng Deng 외 arxiv

Long-form chain-of-thought reasoning can improve LLM performance on complex tasks, but models often continue generating unnecessary reasoning after a correct answer has emerged. We refer to this behavior as overthinking.…

Reinforcement Learning