paper-with-me

Papers

CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models

2026-07-01 · Qizhi Jiang, Shuo Wang, Pei Ke, Yuhang Song, Ke Qin arxiv

Large Reasoning Models (LRMs) have achieved remarkable success on complex tasks by leveraging long chain-of-thought (CoT) trajectories, yet they frequently exhibit overthinking on simple queries, resulting in significant token overhead and reduced inference efficiency. However, existing compression methods predominantly apply uniform length reduction or rely on coarse-grained difficulty estimation, often leading to performance degradation on difficult problems. To address this limitation, we propose Confidence-Adaptive Thinking (CAT), a framework that incorporates the model's intrinsic self-certainty signals as confidence into the preference optimization process, which autonomously modulates reasoning lengths based on problem difficulty. Experimental results show that CAT consistently outperforms state-of-the-art baselines on reasoning accuracy across multiple benchmarks on different base models. Our work enables LRMs to effectively compress confident responses while deliberating on uncertain ones, offering a potentially robust solution for balancing accuracy and latency in practical industrial scenarios.

📄 PDF Abstract BibTeX arXiv:2607.00862

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning

2025-05-21 · Rongzhi Zhu, Yi Liu, Zequn Sun, Yiwei Wang 외

Large reasoning models (LRMs) have significantly advanced performance on complex tasks, yet their tendency to overthink introduces inefficiencies. This study investigates the internal mechanisms of reinforcement learning…

Reinforcement Learning (RL)

ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces

2026-02-12 · Xin Xu, Tong Yu, Xiang Chen, Haoliang Wang 외 arxiv

Recent work explores latent reasoning to improve reasoning efficiency by replacing explicit reasoning trajectories with continuous representations in a latent space, yet its effectiveness varies across settings. Analysis…

Efficient Reasoning with Balanced Thinking

2026-03-12 · Yulin Li, Tengyao Tu, Li Ding, Junjie Wang 외 arxiv

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore suffic…

Question Answering

ReThinker: Scientific Reasoning by Rethinking with Guided Reflection and Confidence Control

2026-02-04 · Zhentao Tang, Yuqi Cui, Shixiong Kai, Wenqian Zhao 외 arxiv

Expert-level scientific reasoning remains challenging for large language models, particularly on benchmarks such as Humanity's Last Exam (HLE), where rigid tool pipelines, brittle multi-agent coordination, and inefficien…

Reasoning Models Better Express Their Confidence

2025-05-20 · Dongkeun Yoon, Seungone Kim, Sohee Yang, Sunkyoung Kim 외

Despite their strengths, large language models (LLMs) often fail to communicate their confidence accurately, making it difficult to assess when they might be wrong and limiting their reliability. In this work, we demonst…

In-Context Learning