paper-with-me

홈 › Papers

Efficient and Interpretable Robot Manipulation with Graph Neural Networks

2021-02-25 · Yixin Lin, Austin S. Wang, Eric Undersander, Akshara Rai

Manipulation tasks, like loading a dishwasher, can be seen as a sequence of spatial constraints and relationships between different objects. We aim to discover these rules from demonstrations by posing manipulation as a classification problem over a graph, whose nodes represent task-relevant entities like objects and goals, and present a graph neural network (GNN) policy architecture for solving this problem from demonstrations. In our experiments, a single GNN policy trained using imitation learning (IL) on 20 expert demos can solve blockstacking, rearrangement, and dishwasher loading tasks; once the policy has learned the spatial structure, it can generalize to a larger number of objects, goal configurations, and from simulation to the real world. These experiments show that graphical IL can solve complex long-horizon manipulation problems without requiring detailed task descriptions. Videos can be found at: https://youtu.be/POxaTDAj7aY.

📄 PDF Abstract BibTeX arXiv:2102.13177

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingGraph Neural NetworkImitation LearningRobot Manipulation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Learning Rope Manipulation Policies Using Dense Object Descriptors Trained on Synthetic Depth Data

2020-03-03 · Priya Sundaresan, Jennifer Grannen, Brijen Thananjeyan, Ashwin Balakrishna 외

Robotic manipulation of deformable 1D objects such as ropes, cables, and hoses is challenging due to the lack of high-fidelity analytic models and large configuration spaces. Furthermore, learning end-to-end manipulation…

Robot ManipulationVisual Reasoning

Build on Priors: Vision--Language--Guided Neuro-Symbolic Imitation Learning for Data-Efficient Real-World Robot Manipulation

2026-04-04 · Pierrick Lorang, Johannes Huemer, Timothy Duggan, Kai Goebel 외 arxiv

Enabling robots to learn long-horizon manipulation tasks from a handful of demonstrations remains a central challenge in robotics. Existing neuro-symbolic approaches often rely on hand-crafted symbolic abstractions, sema…

Robot ManipulationData Augmentation

SlotVLA: Towards Modeling of Object-Relation Representations in Robotic Manipulation

2025-11-10 · Taisei Hanyu, Nhat Chung, Huy Le, Toan Nguyen 외 arxiv

Inspired by how humans reason over discrete objects and their relationships, we explore whether compact object-centric and object-relation representations can form a foundation for multitask robotic manipulation. Most ex…

Bridging Visual Perception with Contextual Semantics for Understanding Robot Manipulation Tasks

2019-09-16 · Chen Jiang, Martin Jagersand

Understanding manipulation scenarios allows intelligent robots to plan for appropriate actions to complete a manipulation task successfully. It is essential for intelligent robots to semantically interpret manipulation k…

AttributeCommon Sense ReasoningKnowledge GraphsLanguage Modeling+2

SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertainty

2026-03-05 · Jongseok Lee, Ribin Balachandran, Harsimran Singh, Jianxiang Feng 외 arxiv

Deep learning (DL) has enabled impressive advances in robotic perception, yet its limited robustness and lack of interpretability hinder reliable deployment in safety critical applications. We propose a concept termed pe…

Point Cloud Registration