paper-with-me

Papers

Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning

2025-05-22 · Siqu Ou, Hongcheng Liu, Pingjie Wang, Yusheng Liao, Chuan Xuan, Yanfeng Wang, Yu Wang

While chains-of-thought (CoT) have advanced complex reasoning in multimodal large language models (MLLMs), existing methods remain confined to text or static visual domains, often faltering in dynamic spatial reasoning tasks. To bridge this gap, we present GRASSLAND, a novel maze navigation benchmark designed to evaluate dynamic spatial reasoning. Our experiments show that augmenting textual reasoning chains with dynamic visual drafts, overlaid on input images, significantly outperforms conventional approaches, offering new insights into spatial reasoning in evolving environments. To generalize this capability, we propose D2R (Dynamic Draft-Augmented Reasoning), a training-free framework that seamlessly integrates textual CoT with corresponding visual drafts into MLLMs. Extensive evaluations demonstrate that D2R consistently enhances performance across diverse tasks, establishing a robust baseline for dynamic spatial reasoning without requiring model fine-tuning. Project is open at https://github.com/Cratileo/D2R.

📄 PDF Abstract BibTeX arXiv:2505.16579

Code (1)

cratileo/d2r 공식 구현

Tasks

Spatial Reasoning

Similar Papers 제목 키워드 기반

Bridging Draft Policy Misalignment: Group Tree Optimization for Speculative Decoding

2025-09-26 · Shijing Hu, Jingyang Li, Zhihui Lu, Pan Zhou arxiv

Speculative decoding accelerates large language model (LLM) inference by letting a lightweight draft model propose multiple tokens that the target model verifies in parallel. Yet existing training objectives optimize onl…

Double: Breaking the Acceleration Limit via Double Retrieval Speculative Parallelism

2026-01-09 · Yuhao Shen, Tianyu Liu, Junyi Shen, Jinyang Wu 외 arxiv

Parallel Speculative Decoding (PSD) accelerates traditional Speculative Decoding (SD) by overlapping draft generation with verification. However, it remains hampered by two fundamental challenges: (1) a theoretical speed…

CoVSpec: Efficient Device-Edge Co-Inference for Vision-Language Models via Speculative Decoding

2026-05-04 · Yuanyuan Jia, Shunpu Tang, Qianqian Yang arxiv

Vision-language models (VLMs) have demonstrated strong capabilities in multimodal perception and reasoning. However, deploying large VLMs on mobile devices remains challenging due to their substantial computational and m…

TapOut: A Bandit-Based Approach to Dynamic Speculative Decoding

2025-11-03 · Aditya Sridhar, Nish Sinnadurai, Sean Lie, Vithursan Thangarasa arxiv

Speculative decoding accelerates LLMs by using a lightweight draft model to generate tokens autoregressively before verifying them in parallel with a larger target model. However, determining the optimal number of tokens…

Multi-Armed Bandits

AdaEDL: Early Draft Stopping for Speculative Decoding of Large Language Models via an Entropy-based Lower Bound on Token Acceptance Probability

2024-10-24 · Sudhanshu Agrawal, Wonseok Jeon, Mingu Lee

Speculative decoding is a powerful technique that attempts to circumvent the autoregressive constraint of modern Large Language Models (LLMs). The aim of speculative decoding techniques is to improve the average inferenc…