paper-with-me

Papers

Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning

2026-07-01 · Hongxing Li, Xiufeng Huang, Dingming Li, Wenjing Jiang, Zixuan Wang, Haolei Xu, Hanrong Zhang, Haiwen Hong, Longtao Huang, Hui Xue, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen arxiv

Fine-grained visual reasoning remains challenging for vision-language models, especially when small but critical visual cues are buried in high-resolution images. Existing approaches rely on repeated cropping or test-time visual search to introduce local evidence, but they typically do not explicitly distinguish perception from reasoning. In this paper, we propose Perceive-to-Reason (P2R), a unified framework that formulates fine-grained visual reasoning as a two-stage process: the model first localizes question-relevant evidence as a Perceiver, and then answers the question as a Reasoner based on the annotated image and cropped regions. To better align training with this decoupled formulation, we further introduce Perception-Reasoning Alternating GRPO (PRA-GRPO), a role-aware reinforcement learning strategy that alternates between perception-focused and reasoning-focused updates using only final-answer supervision. Built on top of Qwen3-VL-Instruct-2B/4B/8B, P2R consistently improves performance across model scales. In particular, P2R-4B achieves 93.2% on V-Star, 81.9% on HR-Bench-4K, and 80.5% on HR-Bench-8K, substantially outperforming its corresponding backbone. Further experiments show that the benefits of P2R extend beyond high-resolution benchmarks to broader multimodal reasoning tasks. These results suggest that explicitly decoupling perception from reasoning provides an effective framework for fine-grained visual reasoning.

📄 PDF Abstract BibTeX arXiv:2607.01191

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningMultimodal ReasoningVisual Reasoning

Similar Papers 제목 키워드 기반

Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learning

2026-02-26 · Hao Yu, Shuning Jia, Guanghao Li, Wenhao Jiang 외 arxiv

Vision-language models (VLMs) often struggle with geometric reasoning due to their limited perception of fundamental diagram elements. To tackle this challenge, we introduce GeoPerceive, a benchmark comprising diagram in…

Reinforcement Learning

HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual Perceiver

2025-01-01 · CVPR 2025 1 · Cong Wei, Yujie Zhong, Haoxian Tan, Yong liu 외

This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs). Despite significant progress in current unified se…

Reasoning SegmentationSegmentationUniversal SegmentationVideo Segmentation+2

HPP: Hierarchical Programmatic Probing for Long Video Understanding by Decoupling Perception and Reasoning

2026-06-19 · Awais Rauf, Ahmed Hasssan, Greg Slabaugh arxiv

Understanding long videos requires fine-grained perception and multi-step, higher-order reasoning over complex, long-range spatio-temporal dynamics. Vision-language models (VLMs) encode video frames into visual tokens an…

Relational ReasoningSemantic Retrieval

The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models

2026-06-05 · Lujun Li, Lama Sleem, Niccolo Gentile, Yangjie Xu 외 arxiv

Recent vision-language models (VLMs) excel at multimodal understanding and reasoning, yet their fine-grained visual perception remains underexplored. A natural extension of ``How many r are there in Strawberry?'' asks: h…

Spatial ReasoningVisual Reasoning

Decoupling the Image Perception and Multimodal Reasoning for Reasoning Segmentation with Digital Twin Representations

2025-06-09 · Yizhen Li, Dell Zhang, Xuelong Li, Yiqing Shen

Reasoning Segmentation (RS) is a multimodal vision-text task that requires segmenting objects based on implicit text queries, demanding both precise visual perception and vision-text reasoning capabilities. Current RS ap…

Large Language ModelMultimodal ReasoningReasoning Segmentation