paper-with-me

홈 › Papers

Map2Thought: Explicit 3D Spatial Reasoning via Metric Cognitive Maps

2026-01-16 · Xiangjun Gao, Zhensong Zhang, Dave Zhenyu Chen, Songcen Xu, Long Quan, Eduardo Pérez-Pellitero, Youngkyoon Jang arxiv

We propose Map2Thought, a framework that enables explicit and interpretable spatial reasoning for 3D VLMs. The framework is grounded in two key components: Metric Cognitive Map (Metric-CogMap) and Cognitive Chain-of-Thought (Cog-CoT). Metric-CogMap provides a unified spatial representation by integrating a discrete grid for relational reasoning with a continuous, metric-scale representation for precise geometric understanding. Building upon the Metric-CogMap, Cog-CoT performs explicit geometric reasoning through deterministic operations, including vector operations, bounding-box distances, and occlusion-aware appearance order cues, producing interpretable inference traces grounded in 3D structure. Experimental results show that Map2Thought enables explainable 3D understanding, achieving 59.9% accuracy using only half the supervision, closely matching the 60.9% baseline trained with the full dataset. It consistently outperforms state-of-the-art methods by 5.3%, 4.8%, and 4.0% under 10%, 25%, and 50% training subsets, respectively, on the VSI-Bench.

📄 PDF Abstract BibTeX arXiv:2601.11442

Code (0)

등록된 구현이 없습니다.

Tasks

Relational ReasoningSpatial Reasoning

Similar Papers 제목 키워드 기반

PointVG-R: Internalizing Geometric Reasoning in MLLMs for Precise Pointing Localization via Visual Chain of Thought

2026-06-23 · Ling Li, Bowen Liu, Zinuo Zhan, Jianhui Zhong 외 arxiv

Pointing-based visual grounding requires models to precisely locate target objects by deciphering complex spatial relationships between the visual scene and pointing gestures. Traditional methods typically encode input i…

Reinforcement LearningVisual Grounding

Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces

2024-12-18 · CVPR 2025 1 · Jihan Yang, Shusheng Yang, Anjali W. Gupta, Rilyn Han 외

Humans possess the visual-spatial intelligence to remember spaces from sequential visual observations. However, can Multimodal Large Language Models (MLLMs) trained on million-scale video datasets also ``think in space''…

Question AnsweringSpatial Reasoning

MME-CC: A Challenging Multi-Modal Evaluation Benchmark of Cognitive Capacity

2025-11-05 · Kaiyuan Zhang, Chenghao Yang, Zhoufutu Wen, Sihang Yuan 외 arxiv

As reasoning models scale rapidly, the essential role of multimodality in human cognition has come into sharp relief, driving a growing need to probe vision-centric cognitive behaviors. Yet, existing multimodal benchmark…

GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models

2025-10-23 · Nannan Shi, Chuanyu Qin, Shipeng Song, Man Luo arxiv

Large language models (LLMs) have demonstrated strong reasoning capabilities in text-based mathematical problem solving; however, when adapted to visual reasoning tasks, particularly geometric problem solving, their perf…

Mathematical ReasoningVisual Reasoning

Time-Scaling Is What Agents Need Now

2026-01-06 · Zhi Liu, Guangzhi Wang arxiv

Early artificial intelligence paradigms exhibited separated cognitive functions: Neural Networks focused on "perception-representation," Reinforcement Learning on "decision-making-behavior," and Symbolic AI on "knowledge…

Reinforcement Learning