paper-with-me

홈 › Papers

Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images

2026-04-13 · Zheng Jiang, Yiming Chen, Nan He, Jiahui Chen, Chaoyang Li, Houde Qian, Lifeng Sun arxiv

Recent multimodal large language models (MLLMs) have begun to support Thinking with Images by invoking visual tools such as zooming and cropping during inference. Yet these systems remain brittle in fine-grained visual reasoning because they must decide where to look before they have access to the evidence needed to make that decision correctly. We identify this circular dependency as the Grounding Paradox. To address it, we propose Test-Time Scaling over Perception (TTSP), a framework that treats perception itself as a scalable inference process. TTSP generates multiple exploratory perception traces, filters unreliable traces using entropy-based confidence estimation, distills validated observations into structured knowledge, and iteratively refines subsequent exploration toward unresolved uncertainty. Extensive experiments on high-resolution and general multimodal reasoning benchmarks show that TTSP consistently outperforms strong baselines across backbone sizes, while also exhibiting favorable scalability and token efficiency. Our results suggest that scaling perception at test time is a promising direction for robust multimodal reasoning under perceptual uncertainty.

📄 PDF Abstract BibTeX arXiv:2604.11025

Code (0)

등록된 구현이 없습니다.

Tasks

Multimodal ReasoningVisual Reasoning

Similar Papers 제목 키워드 기반

Benchmark Test-Time Scaling of General LLM Agents

2026-02-22 · Xiaochuan Li, Ryan Ming, Pranav Setlur, Abhijay Paladugu 외 arxiv

LLM agents are increasingly expected to function as general-purpose systems capable of resolving open-ended user requests. While existing benchmarks focus on domain-aware environments for developing specialized agents, e…

RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Model

2025-10-13 · Mingtong Dai, Lingbo Liu, Yongjie Bai, Yang Liu 외 arxiv

Vision-Language-Action (VLA) models have become a prominent paradigm for embodied intelligence, yet further performance improvements typically rely on scaling up training data and model size -- an approach that is prohib…

Scaling Properties of Diffusion Models for Perceptual Tasks

2024-11-12 · CVPR 2025 1 · Rahul Ravishankar, Zeeshan Patel, Jathushan Rajasegaran, Jitendra Malik

In this paper, we argue that iterative computation with diffusion models offers a powerful paradigm for not only generation but also visual perception tasks. We unify tasks such as depth estimation, optical flow, and amo…

Depth EstimationImage-to-Image TranslationOptical Flow Estimation

VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception

2025-09-25 · Ziang Yan, Xinhao Li, Yinan He, Zhengrong Yue 외 arxiv

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited b…

Reinforcement LearningMultimodal Reasoning

Training Vision-Language Process Reward Models for Test-Time Scaling in Multimodal Reasoning: Key Insights and Lessons Learned

2025-09-27 · Brandon Ong, Tej Deep Pala, Vernon Toh, William Chandra Tjhi 외 arxiv

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision L…

Multimodal ReasoningVisual Grounding