paper-with-me

Papers

Think before Go: Hierarchical Reasoning for Image-goal Navigation

2026-04-19 · Pengna Li, Kangyi Wu, Shaoqing Xu, Fang Li, Lin Zhao, Long Chen, Zhi-Xin Yang, Nanning Zheng arxiv

Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similarities of target and observation images and directly predicts the actions. However, when the target is distant or lies in another room, such methods fail to extract informative visual cues, leading the agent to wander around. Motivated by the human cognitive principle that deliberate, high-level reasoning guides fast, reactive execution in complex tasks, we propose Hierarchical Reasoning Navigation (HRNav), a framework that decomposes image-goal navigation into high-level planning and low-level execution. In high-level planning, a vision-language model is trained on a self-collected dataset to generate a short-horizon plan, such as whether the agent should walk through the door or down the hallway. This downgrades the difficulty of the long-horizon task, making it more amenable to the execution part. In low-level execution, an online reinforcement learning policy is utilized to decide actions conditioned on the short-horizon plan. We also devise a novel Wandering Suppression Penalty (WSP) to further reduce the wandering problem. Together, these components form a hierarchical framework for Image-Goal Navigation. Extensive experiments in both simulation and real-world environments demonstrate the superiority of our method.

📄 PDF Abstract BibTeX arXiv:2604.17407

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

WAT: Online Video Understanding Needs Watching Before Thinking

2026-03-12 · Zifan Han, Hongbo Sun, Jinglin Xu, Canhui Tang 외 arxiv

Multimodal Large Language Models (MLLMs) have shown strong capabilities in image understanding, motivating recent efforts to extend them to video reasoning. However, existing Video LLMs struggle in online streaming scena…

Think about it! Improving defeasible reasoning by first modeling the question scenario

2021-10-24 · Aman Madaan, Niket Tandon, Dheeraj Rajagopal, Peter Clark 외

Defeasible reasoning is the mode of reasoning where conclusions can be overturned by taking into account new evidence. Existing cognitive science literature on defeasible reasoning suggests that a person forms a mental m…

Think about it! Improving defeasible reasoning by first modeling the question scenario.

2021-11-01 · EMNLP 2021 11 · Aman Madaan, Niket Tandon, Dheeraj Rajagopal, Peter Clark 외

Defeasible reasoning is the mode of reasoning where conclusions can be overturned by taking into account new evidence. Existing cognitive science literature on defeasible reasoning suggests that a person forms a “mental …

Generate Subgoal Images before Act: Unlocking the Chain-of-Thought Reasoning in Diffusion Model for Robot Manipulation with Multimodal Prompts

2024-01-01 · CVPR 2024 1 · Fei Ni, Jianye Hao, Shiguang Wu, Longxin Kou 외

Robotics agents often struggle to understand and follow the multi-modal prompts in complex manipulation scenes which are challenging to be sufficiently and accurately described by text alone. Moreover for long-horizo…

Image GenerationInstruction FollowingRobot ManipulationVisual Reasoning

Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Models

2025-08-18 · Zhifei Xie, Ziyang Ma, Zihang Liu, Kaiyu Pang 외 arxiv

Reasoning is essential for effective communication and decision-making. While recent advances in LLMs and MLLMs have shown that incorporating explicit reasoning significantly improves understanding and generalization, re…

Arithmetic Reasoning