paper-with-me

Papers

Continuously Improving Mobile Manipulation with Autonomous Real-World RL

2024-09-30 · Russell Mendonca, Emmanuel Panov, Bernadette Bucher, Jiuguang Wang, Deepak Pathak

We present a fully autonomous real-world RL framework for mobile manipulation that can learn policies without extensive instrumentation or human supervision. This is enabled by 1) task-relevant autonomy, which guides exploration towards object interactions and prevents stagnation near goal states, 2) efficient policy learning by leveraging basic task knowledge in behavior priors, and 3) formulating generic rewards that combine human-interpretable semantic information with low-level, fine-grained observations. We demonstrate that our approach allows Spot robots to continually improve their performance on a set of four challenging mobile manipulation tasks, obtaining an average success rate of 80% across tasks, a 3-4 improvement over existing approaches. Videos can be found at https://continual-mobile-manip.github.io/

📄 PDF Abstract BibTeX arXiv:2409.20568

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

2021-07-28 · Charles Sun, Jędrzej Orbik, Coline Devin, Brian Yang 외

We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement …

Continual LearningNavigatereinforcement-learningReinforcement Learning+1

Adaptive Mobile Manipulation for Articulated Objects In the Open World

2024-01-25 · Haoyu Xiong, Russell Mendonca, Kenneth Shaw, Deepak Pathak

Deploying robots in open-ended unstructured environments such as homes has been a long-standing research problem. However, robots are often studied only in closed-off lab settings, and prior mobile manipulation work is r…

Stereo Multistage Spatial Attention for Real-Time Mobile Manipulation Under Visual Scale Variation and Disturbances

2026-05-01 · Xianbo Cai, Hideyuki Ichiwara, Hyogo Hiruma, Masaki Yoshikawa 외 arxiv

Robots operating in open, unstructured real-world environments must rely on onboard visual perception while autonomously moving across different locations. Continuous changes in onboard camera viewpoints cause significan…

DynaMOMA: Instantaneous Prediction of Grasp Poses for Mobile Manipulation of Dynamic Objects

2026-06-24 · Zhinan Yu, Junyan Xu, Jiazhao Zhang, Zheng Qin 외 arxiv

Mobile manipulation is a fundamental robotics task and has advanced rapidly in recent years, enabling robots to navigate, reach, and interact with objects in complex environments. However, mobile manipulation of dynamic …

Reinforcement LearningTrajectory Prediction

DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulation

2024-11-07 · Peiqi Liu, Zhanqiu Guo, Mohit Warke, Soumith Chintala 외

Significant progress has been made in open-vocabulary mobile manipulation, where the goal is for a robot to perform tasks in any environment given a natural language description. However, most current systems assume a st…

Object Localization