paper-with-me

Papers

MatryoshkaThinking: Recursive Test-Time Scaling Enables Efficient Reasoning

2025-10-11 · Hongwei Chen, Yishu Lei, Dan Zhang, Bo Ke, Danxiang Zhu, Xuyi Chen, Yuxiang Lu, Zhengjie Huang, Shikun Feng, Jingzhou He, Yu Sun, Hua Wu, Haifeng Wang arxiv

Test-time scaling has emerged as a promising paradigm in language modeling, wherein additional computational resources are allocated during inference to enhance model performance. Recent approaches, such as DeepConf, have demonstrated the efficacy of this strategy, however, they often incur substantial computational overhead to achieve competitive results. In this work, we propose MatryoshkaThinking, a novel method that significantly reduces computational cost while maintaining state-of-the-art performance. Specifically, MatryoshkaThinking attains a score of 99.79 on AIME2025 using only 4% of the computation required by DeepConf. The core of our approach lies in the recursive exploitation of the model's intrinsic capabilities in reasoning, verification, and summarization, which collectively enhance the retention of correct solutions and reduce the disparity between Pass@k and Pass@1. Comprehensive evaluations across multiple open-source models and challenging multi-modal reasoning benchmarks validate the effectiveness and generality of our method. These findings offer new insights into the design of efficient and scalable test-time inference strategies for advanced language models.

📄 PDF Abstract BibTeX arXiv:2510.10293

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Recursive Scaling in Masked Diffusion Models

2026-06-16 · Alba Carballo-Castro, Julianna Piskorz, Paulius Rauba, Mihaela van der Schaar 외 arxiv

Masked diffusion models (MDMs) have recently emerged as a promising paradigm for sequence generation. Scaling MDMs is conventionally achieved by increasing the parameter count or the number of denoising steps. We introdu…

Scaling Test-Time Compute for Agentic Coding

2026-04-16 · Joongwon Kim, Wannan Yang, Kelvin Niu, Hongming Zhang 외 arxiv

Test-time scaling has become a powerful way to improve large language models. However, existing methods are best suited to short, bounded outputs that can be directly compared, ranked or refined. Long-horizon coding agen…

Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models

2025-09-30 · Siddarth Venkatraman, Vineet Jain, Sarthak Mittal, Vedant Shah 외 arxiv

Test-time scaling methods improve the capabilities of large language models (LLMs) by increasing the amount of compute used during inference to make a prediction. Inference-time compute can be scaled in parallel by choos…

Reinforcement Learning

Generalization in LLM Problem Solving: The Case of the Shortest Path

2026-04-16 · Yao Tong, Jiayuan Ye, Anastasia Borovykh, Reza Shokri arxiv

Whether language models can systematically generalize remains actively debated. Yet empirical performance is jointly shaped by multiple factors such as training data, training paradigms, and inference-time strategies, ma…

Reinforcement Learning

LADDER: Self-Improving LLMs Through Recursive Problem Decomposition

2025-03-02 · Toby Simonds, Akira Yoshiyama

We introduce LADDER (Learning through Autonomous Difficulty-Driven Example Recursion), a framework enabling LLMs to autonomously improve their problem-solving capabilities through self-guided learning. By recursively gen…

Problem Decompositionreinforcement-learningReinforcement Learning