paper-with-me

Papers

NOD-TAMP: Generalizable Long-Horizon Planning with Neural Object Descriptors

2023-11-02 · Shuo Cheng, Caelan Garrett, Ajay Mandlekar, Danfei Xu

Solving complex manipulation tasks in household and factory settings remains challenging due to long-horizon reasoning, fine-grained interactions, and broad object and scene diversity. Learning skills from demonstrations can be an effective strategy, but such methods often have limited generalizability beyond training data and struggle to solve long-horizon tasks. To overcome this, we propose to synergistically combine two paradigms: Neural Object Descriptors (NODs) that produce generalizable object-centric features and Task and Motion Planning (TAMP) frameworks that chain short-horizon skills to solve multi-step tasks. We introduce NOD-TAMP, a TAMP-based framework that extracts short manipulation trajectories from a handful of human demonstrations, adapts these trajectories using NOD features, and composes them to solve broad long-horizon, contact-rich tasks. NOD-TAMP solves existing manipulation benchmarks with a handful of demonstrations and significantly outperforms prior NOD-based approaches on new tabletop manipulation tasks that require diverse generalization. Finally, we deploy NOD-TAMP on a number of real-world tasks, including tool-use and high-precision insertion. For more details, please visit https://nodtamp.github.io/.

📄 PDF Abstract BibTeX arXiv:2311.01530

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityMotion PlanningObjectTask and Motion Planning

Similar Papers 제목 키워드 기반

A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects

2020-11-16 · Anthony Simeonov, Yilun Du, Beomjoon Kim, Francois R. Hogan 외

We present a framework for solving long-horizon planning problems involving manipulation of rigid objects that operates directly from a point-cloud observation, i.e. without prior object models. Our method plans in the s…

Graph AttentionMotion PlanningObjectTask and Motion Planning

Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness

2024-03-15 · Aidan Curtis, George Matheos, Nishad Gothoskar, Vikash Mansinghka 외

Integrated task and motion planning (TAMP) has proven to be a valuable approach to generalizable long-horizon robotic manipulation and navigation problems. However, the typical TAMP problem formulation assumes full obser…

Motion PlanningTask and Motion Planning

Plan Along the Way: Event-Triggered Foundation-Model Planning for TAMP Execution in Partially Observable Manipulation

2026-08-28 · Puru Ojha, Narendhiran Vijayakumar, Nav Singhal, Girish Varma 외 arxiv

Manipulation in partially observable environments requires planning under incomplete scene information. In such settings, an initially valid plan may execute successfully yet remain insufficient for task completion. Exis…

Motion Planning

Leveraging Inter-object Affordances for Efficient Planning in Contact-rich Tasks

2026-08-26 · Pouya P. Niaz, Justus Piater, Alejandro Agostini arxiv

Traditional task-and-motion planning (TAMP) approaches primarily focus on defining sequences of actions along with the necessary geometric and kinematic constraints to execute long-horizon tasks. However, their applicabi…

Motion Planning

Guided Imitation of Task and Motion Planning

2021-12-06 · Michael James McDonald, Dylan Hadfield-Menell

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) met…

Imitation LearningMotion PlanningTask and Motion Planning