ESCAPE: Episodic Spatial Memory and Adaptive Execution Policy for Long-Horizon Mobile Manipulation

2026-04-15 · Jingjing Qian, Zeyuan He, Chen Shi, Lei Xiao, Li Jiang arxiv

Coordinating navigation and manipulation with robust performance is essential for embodied AI in complex indoor environments. However, as tasks extend over long horizons, existing methods often struggle due to catastrophic forgetting, spatial inconsistency, and rigid execution. To address these issues, we propose ESCAPE (Episodic Spatial Memory Coupled with an Adaptive Policy for Execution), operating through a tightly coupled perception-grounding-execution workflow. For robust perception, ESCAPE features a Spatio-Temporal Fusion Mapping module to autoregressively construct a depth-free, persistent 3D spatial memory, alongside a Memory-Driven Target Grounding module for precise interaction mask generation. To achieve flexible action, our Adaptive Execution Policy dynamically orchestrates proactive global navigation and reactive local manipulation to seize opportunistic targets. ESCAPE achieves state-of-the-art performance on the ALFRED benchmark, reaching 65.09% and 60.79% success rates in test seen and unseen environments with step-by-step instructions. By reducing redundant exploration, our ESCAPE attains substantial improvements in path-length-weighted metrics and maintains robust performance (61.24% / 56.04%) even without detailed guidance for long-horizon tasks.

📄 PDF Abstract BibTeX arXiv:2604.13633

Code (0)

등록된 구현이 없습니다.

UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams

2026-07-28 · Siyu Xia, Chenheng Zhang, Yanting Wu, Haoxuan Li 외 arxiv

Memory is essential for LLM agents to accumulate task experience and reuse task-specific execution strategies. However, real-world deployment over boundary-agnostic and evolving task streams exposes a fundamental stabili…

Spatially-Aware Transformer for Embodied Agents

2024-02-23 · Junmo Cho, Jaesik Yoon, Sungjin Ahn

Episodic memory plays a crucial role in various cognitive processes, such as the ability to mentally recall past events. While cognitive science emphasizes the significance of spatial context in the formation and retriev…

reinforcement-learning Reinforcement Learning

Continual and Multi-task Reinforcement Learning With Shared Episodic Memory

2019-05-07 · Artyom Y. Sorokin, Mikhail S. Burtsev

Episodic memory plays an important role in the behavior of animals and humans. It allows the accumulation of information about current state of the environment in a task-agnostic way. This episodic representation can be …

Continual Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

ReMemNav: A Rethinking and Memory-Augmented Framework for Zero-Shot Object Navigation

2026-03-25 · Feng Wu, Wei Zuo, Wenliang Yang, Jun Xiao 외 arxiv

Zero-shot object navigation requires agents to locate unseen target objects in unfamiliar environments without prior maps or task-specific training which remains a significant challenge. Although recent advancements in v…

Spatial Reasoning

Memory as Plans: World-Action Modeling with Memory-Grounded Planning

2026-09-10 · Sizhe Zhao, Haozhe Xie, Weiyu Zhao, Chenchu Zhang 외 hf

Mainstream robotic policies often adopt a Markovian formulation, but many complex real-world manipulation tasks are inherently non-Markovian, requiring long-horizon memory beyond the current observation. Existing memory …