paper-with-me

Papers

ASPIRE: Agentic /Skills Discovery for Robotics

2026-06-30 · Runyu Lu, Yubo Wu, Ethan Kou, Letian Fu, Wenli Xiao, Ajay Mandlekar, Yinzhen Xu, Guanya Shi, Ken Goldberg, Ang Chen, Mosharaf Chowdhury, Yuke Zhu, Linxi "Jim" Fan, Guanzhi Wang hf

Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures. We introduce ASPIRE (Agentic Skill Programming through Iterative Robot Exploration), a continual learning system that autonomously writes and refines robot control programs in a code-as-policy paradigm while compounding experience into a reusable skill library. ASPIRE discovers skills that persist across tasks, simulation and real-world settings, and embodiments. It operates in an open-ended loop with three components: (1) a closed-loop robot execution engine that exposes fine-grained multimodal traces, enabling autonomous failure diagnosis, repair synthesis, and validation; (2) a continually expanding skill library that distills validated fixes into reusable, transferable knowledge; and (3) evolutionary search that generates diverse task sequences and control programs to explore beyond single-trajectory refinement. ASPIRE surpasses prior methods by up to 77% on LIBERO-Pro manipulation under perturbation, 72% on Robosuite bimanual handover, and 32% on BEHAVIOR-1K long-horizon household tasks. Its accumulated library also enables zero-shot generalization to unseen long-horizon tasks: on LIBERO-Pro Long, ASPIRE achieves 31% success versus 4% for prior methods despite their use of test-time reasoning and retries. Finally, simulation-discovered skills provide initial evidence of sim-to-real transfer, substantially reducing real-robot programming effort across different embodiments and robot APIs.

📄 PDF Abstract BibTeX arXiv:2607.00272

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot GeneralizationContinual Learning

Similar Papers 제목 키워드 기반

SoK: Agentic Skills -- Beyond Tool Use in LLM Agents

2026-02-24 · Yanna Jiang, Delong Li, Haiyu Deng, Baihe Ma 외 arxiv

Agentic systems increasingly rely on reusable procedural capabilities, \textit{a.k.a., agentic skills}, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledg…

Agentic Skill Discovery

2024-05-23 · Xufeng Zhao, Cornelius Weber, Stefan Wermter

Language-conditioned robotic skills make it possible to apply the high-level reasoning of Large Language Models (LLMs) to low-level robotic control. A remaining challenge is to acquire a diverse set of fundamental skills…

Language Modelling

Skill Transfer and Discovery for Sim-to-Real Learning: A Representation-Based Viewpoint

2024-04-07 · Haitong Ma, Zhaolin Ren, Bo Dai, Na Li

We study sim-to-real skill transfer and discovery in the context of robotics control using representation learning. We draw inspiration from spectral decomposition of Markov decision processes. The spectral decomposition…

Representation Learning

Playful Agentic Robot Learning

2026-06-17 · Junyi Zhang, Jiaxin Ge, Hanjun Yoo, Letian Fu 외 arxiv

Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after exp…

Agentic Neuro-Symbolic Planning and Commissioning for Human-in-the-Loop Industrial Robotics with Digital Twins

2026-06-06 · Zhihao Liu, Victor Nan Fernandez-Ayala, Tianyu Wang, Qiang Qin 외 arxiv

Flexible robotic automation requires systems that interpret operator intent, verify physical feasibility, and recover from execution failures across both the planning and execution stages. This paper proposes an agentic …