paper-with-me

Papers

Budget-aware Test-time Scaling via Discriminative Verification

2025-10-16 · Kyle Montgomery, Sijun Tan, Yuqi Chen, Siyuan Zhuang, Tianjun Zhang, Raluca Ada Popa, Chenguang Wang arxiv

Test-time scaling is a powerful strategy for boosting the performance of large language models on complex reasoning tasks. While state-of-the-art approaches often employ generative verifiers to select the best solution from a pool of candidates, this method incurs prohibitive computational costs, limiting its practicality. In this work, we shift the focus to a more budget-aware paradigm: discriminative verification. We conduct a thorough empirical analysis and demonstrate that while discriminative verifiers may underperform in isolation, combining them with self-consistency in a hybrid approach creates a powerful and efficient test-time scaling mechanism. Notably, under a fixed compute budget, this hybrid approach surpasses state-of-the-art generative verification by a significant margin: achieving up to 15.3\% higher accuracy on AIME2025. Our findings establish that for practical, real-world applications, budget-aware scaling with discriminative verifiers is not only a "free" upgrade over self-consistency, but also a more effective and efficient alternative to costly generative techniques. Code is available at https://github.com/wang-research-lab/verification.

📄 PDF Abstract BibTeX arXiv:2510.14913

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Budget-Aware Tool Use Enables Effective Agent Scaling

2025-11-21 · Tengxiao Liu, Zifeng Wang, Jin Miao, I-Hung Hsu 외 arxiv

Scaling test-time computation has been extended from language model reasoning to tool-augmented agents, where scaling involves not only thinking in tokens but also acting via tool calls that directly constrain environmen…

Timely Machine: Awareness of Time Makes Test-Time Scaling Agentic

2026-01-23 · Yichuan Ma, Linyang Li, Yongkang chen, Peiji Li 외 arxiv

As large language models (LLMs) increasingly tackle complex reasoning tasks, test-time scaling has become critical for enhancing capabilities. However, in agentic scenarios with frequent tool calls, the traditional gener…

Reinforcement Learning

Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agents

2026-03-13 · Yushu Li, Wenlong Deng, Jiajin Li, Xiaoxiao Li arxiv

Test-time scaling has become a dominant paradigm for improving LLM agent reliability, yet current approaches treat compute as an abundant resource, allowing agents to exhaust token and tool budgets on redundant steps or …

When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scaling

2026-04-12 · Shu Zhou, Rui Ling, Junan Chen, Xin Wang 외 arxiv

Scaling test-time compute through extended chains of thought has become a dominant paradigm for improving large language model reasoning. However, existing research implicitly assumes that longer thinking always yields b…

AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

2026-07-16 · Susan Liang, Chao Huang, Filippos Bellos, Jing Bi 외 arxiv

Active visual agents solve fine-grained image tasks by interleaving reasoning with image-grounding actions across multiple turns. However, deployment-time rollout budgets are rarely fixed: some requests permit long rollo…