paper-with-me

Papers

Adaptive Mobile Manipulation for Articulated Objects In the Open World

2024-01-25 · Haoyu Xiong, Russell Mendonca, Kenneth Shaw, Deepak Pathak

Deploying robots in open-ended unstructured environments such as homes has been a long-standing research problem. However, robots are often studied only in closed-off lab settings, and prior mobile manipulation work is restricted to pick-move-place, which is arguably just the tip of the iceberg in this area. In this paper, we introduce Open-World Mobile Manipulation System, a full-stack approach to tackle realistic articulated object operation, e.g. real-world doors, cabinets, drawers, and refrigerators in open-ended unstructured environments. The robot utilizes an adaptive learning framework to initially learns from a small set of data through behavior cloning, followed by learning from online practice on novel objects that fall outside the training distribution. We also develop a low-cost mobile manipulation hardware platform capable of safe and autonomous online adaptation in unstructured environments with a cost of around 20,000 USD. In our experiments we utilize 20 articulate objects across 4 buildings in the CMU campus. With less than an hour of online learning for each object, the system is able to increase success rate from 50% of BC pre-training to 95% using online adaptation. Video results at https://open-world-mobilemanip.github.io/

📄 PDF Abstract BibTeX arXiv:2401.14403

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning

2025-02-16 · Yuanfei Wang, Xiaojie Zhang, Ruihai Wu, Yu Li 외

Articulated object manipulation is a critical capability for robots to perform various tasks in real-world scenarios. Composed of multiple parts connected by joints, articulated objects are endowed with diverse functiona…

Imitation Learning

Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation

2021-03-18 · Mayank Mittal, David Hoeller, Farbod Farshidian, Marco Hutter 외

A kitchen assistant needs to operate human-scale objects, such as cabinets and ovens, in unmapped environments with dynamic obstacles. Autonomous interactions in such environments require integrating dexterous manipulati…

Object

Opening Articulated Structures in the Real World

2024-02-27 · Arjun Gupta, Michelle Zhang, Rishik Sathua, Saurabh Gupta

What does it take to build mobile manipulation systems that can competently operate on previously unseen objects in previously unseen environments? This work answers this question using opening of articulated structures …

parameter estimation

Articulated 3D Scene Graphs for Open-World Mobile Manipulation

2026-02-18 · Martin Büchner, Adrian Röfer, Tim Engelbracht, Tim Welschehold 외 arxiv

Semantics has enabled 3D scene understanding and affordance-driven object interaction. However, robots operating in real-world environments face a critical limitation: they cannot anticipate how objects move. Long-horizo…

Scene UnderstandingPoint Tracking

GAMMA: Generalizable Articulation Modeling and Manipulation for Articulated Objects

2023-09-28 · Qiaojun Yu, JunBo Wang, Wenhai Liu, Ce Hao 외

Articulated objects like cabinets and doors are widespread in daily life. However, directly manipulating 3D articulated objects is challenging because they have diverse geometrical shapes, semantic categories, and kineti…

Manner Of Articulation DetectionRobot ManipulationTrajectory Planning