paper-with-me

홈 › Papers

Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs

2026-04-08 · Mengdan Zhu, Senhao Cheng, Liang Zhao arxiv

Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the cost of tool calls or rely on localized patch-based embeddings that are insufficient to extract semantics in multi-step reasoning. We propose "Decompose, Look, and Reason" (DLR), a reinforced latent reasoning framework that dynamically decomposes queries into textual premises, extracts premise-conditioned continuous visual latents, and deduces answers through grounded rationales. We introduce a three-stage training pipeline and propose a novel Spherical Gaussian Latent Policy, to enable effective exploration in the latent space. Extensive experiments on vision-centric benchmarks show that DLR consistently outperforms strong baselines, including text-only, interleaved multimodal CoT, and latent reasoning methods, while providing superior stepwise interpretability.

📄 PDF Abstract BibTeX arXiv:2604.07518

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Reasoning

Similar Papers 제목 키워드 기반

ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning

2025-07-22 · Chi-Pin Huang, Yueh-Hua Wu, Min-Hung Chen, Yu-Chiang Frank Wang 외 arxiv

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models …

Robot Manipulation

R3A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms

2025-08-04 · Xiaowei Yuan, Lei Jin, Haoxin Zhang, Ziyang Huang 외 arxiv

Retrieval-augmented generation (RAG) plays a critical role in user-generated content (UGC) platforms, but its effectiveness critically depends on accurate query-document relevance assessment. Despite recent advances in a…

Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models

2026-06-13 · Dianqiao Lei, Lianlei Shan arxiv

Existing Vision-Language-Action (VLA) models predominantly rely on explicit Chain-of-Thought (CoT) reasoning to bridge perception and action. While effective, this paradigm suffers from high computational costs and error…

Reinforcement LearningText Generation

Reinforced Latent Reasoning for LLM-based Recommendation

2025-05-25 · Yang Zhang, Wenxin Xu, Xiaoyan Zhao, Wenjie Wang 외

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existin…

Recommendation SystemsReinforcement Learning (RL)

KG-Reasoner: A Reinforced Model for End-to-End Multi-Hop Knowledge Graph Reasoning

2026-04-14 · Shuai Wang, Yinan Yu arxiv

Large Language Models (LLMs) exhibit strong abilities in natural language understanding and generation, yet they struggle with knowledge-intensive reasoning. Structured Knowledge Graphs (KGs) provide an effective form of…

Knowledge Base Question AnsweringNatural Language UnderstandingReinforcement LearningKnowledge Graphs