paper-with-me

홈 › Papers

Memory Transfer Planning: LLM-driven Context-Aware Code Adaptation for Robot Manipulation

2025-09-29 · Tomoyuki Kagaya, Subramanian Lakshmi, Yuxuan Lou, Thong Jing Yuan, Jayashree Karlekar, Sugiri Pranata, Natsuki Murakami, Akira Kinose, Yang You arxiv

Large language models (LLMs) are increasingly explored in robot manipulation, but many existing methods struggle to adapt to new environments. Many systems require either environment-specific policy training or depend on fixed prompts and single-shot code generation, leading to limited transferability and manual re-tuning. We introduce Memory Transfer Planning (MTP), a framework that leverages successful control-code examples from different environments as procedural knowledge, using them as in-context guidance for LLM-driven planning. Specifically, MTP (i) generates an initial plan and code using LLMs, (ii) retrieves relevant successful examples from a code memory, and (iii) contextually adapts the retrieved code to the target setting for re-planning without updating model parameters. We evaluate MTP on RLBench, CALVIN, and a physical robot, demonstrating effectiveness beyond simulation. Across these settings, MTP consistently improved success rate and adaptability compared with fixed-prompt code generation, naive retrieval, and memory-free re-planning. Furthermore, in hardware experiments, leveraging a memory constructed in simulation proved effective. MTP provides a practical approach that exploits procedural knowledge to realize robust LLM-based planning across diverse robotic manipulation scenarios, enhancing adaptability to novel environments and bridging simulation and real-world deployment.

📄 PDF Abstract BibTeX arXiv:2509.24160

Code (0)

등록된 구현이 없습니다.

Tasks

Robot ManipulationCode Generation

Similar Papers 제목 키워드 기반

EPD: Long-term Memory Extraction, Context-awared Planning and Multi-iteration Decision @ EgoPlan Challenge ICML 2024

2024-07-28 · Letian Shi, Qi Lv, Xiang Deng, Liqiang Nie

In this technical report, we present our solution for the EgoPlan Challenge in ICML 2024. To address the real-world egocentric task planning problem, we introduce a novel planning framework which comprises three stages: …

Decision MakingTask Planning

Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation

2026-06-25 · Zekai Zhang, Jiahao Li, Jie Zhang, Kaiyuan Gao 외 arxiv

While text-to-image (T2I) models have achieved remarkable progress, they struggle with real-world requests that are often underspecified, implicit, or dependent on up-to-date knowledge. We identify this challenge as the …

Image Generation

State and Memory is All You Need for Robust and Reliable AI Agents

2025-06-30 · Matthew Muhoberac, Atharva Parikh, Nirvi Vakharia, Saniya Virani 외

Large language models (LLMs) have enabled powerful advances in natural language understanding and generation. Yet their application to complex, real-world scientific workflows remain limited by challenges in memory, plan…

AllBenchmarkingDecision MakingNatural Language Understanding+1

LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics

2025-04-30 · Marc Glocker, Peter Hönig, Matthias Hirschmanner, Markus Vincze

We present an embodied robotic system with an LLM-driven agent-orchestration architecture for autonomous household object management. The system integrates memory-augmented task planning, enabling robots to execute high-…

In-Context LearningObjectobject-detectionObject Detection+5

Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agents

2023-08-14 · ICCV 2023 1 · Byeonghwi Kim, Jinyeon Kim, Yuyeong Kim, Cheolhong Min 외

Accomplishing household tasks requires to plan step-by-step actions considering the consequences of previous actions. However, the state-of-the-art embodied agents often make mistakes in navigating the environment and in…

Instruction FollowingVisual Navigation