Transferable Visual Control Policies Through Robot-Awareness
Training visual control policies from scratch on a new robot typically requires generating large amounts of robot-specific data. Could we leverage data previously collected on another robot to reduce or even completely remove this need for robot-specific data? We propose a “robot-aware control” paradigm that achieves this by exploiting readily available knowledge about the robot. We then instantiate this in a robot-aware model-based RL policy by training modular dynamics models that couple a transferable, robot-agnostic world dynamics module with a robot- specific, potentially analytical, robot dynamics module. This also enables us to set up visual planning costs that separately consider the robot agent and the world. Our experiments on tabletop manipulation tasks with simulated and real robots demonstrate that these plug-in improvements dramatically boost the transferability of visual model-based RL policies, even permitting zero-shot transfer onto new robots for the very first time. Project website: https://sites.google.com/view/rac-iclr22
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Know Thyself: Transferable Visual Control Policies Through Robot-Awareness
Training visual control policies from scratch on a new robot typically requires generating large amounts of robot-specific data. How might we leverage data previously collected on another robot to reduce or even complete…
Model-based Reinforcement LearningTransfer LearningVideo PredictionLearning Transferable Policies for Monocular Reactive MAV Control
The ability to transfer knowledge gained in previous tasks into new contexts is one of the most important mechanisms of human learning. Despite this, adapting autonomous behavior to be reused in partially similar setting…
Learning Rope Manipulation Policies Using Dense Object Descriptors Trained on Synthetic Depth Data
Robotic manipulation of deformable 1D objects such as ropes, cables, and hoses is challenging due to the lack of high-fidelity analytic models and large configuration spaces. Furthermore, learning end-to-end manipulation…
Robot ManipulationVisual ReasoningScaling simulation-to-real transfer by learning composable robot skills
We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of di…
Randomized-to-Canonical Model Predictive Control for Real-world Visual Robotic Manipulation
Many works have recently explored Sim-to-real transferable visual model predictive control (MPC). However, such works are limited to one-shot transfer, where real-world data must be collected once to perform the sim-to-r…
Model Predictive Control