홈 › Papers

Simultaneously Learning Vision and Feature-based Control Policies for Real-world Ball-in-a-Cup

2019-02-13 · Devin Schwab, Tobias Springenberg, Murilo F. Martins, Thomas Lampe, Michael Neunert, Abbas Abdolmaleki, Tim Hertweck, Roland Hafner, Francesco Nori, Martin Riedmiller

We present a method for fast training of vision based control policies on real robots. The key idea behind our method is to perform multi-task Reinforcement Learning with auxiliary tasks that differ not only in the reward to be optimized but also in the state-space in which they operate. In particular, we allow auxiliary task policies to utilize task features that are available only at training-time. This allows for fast learning of auxiliary policies, which subsequently generate good data for training the main, vision-based control policies. This method can be seen as an extension of the Scheduled Auxiliary Control (SAC-X) framework. We demonstrate the efficacy of our method by using both a simulated and real-world Ball-in-a-Cup game controlled by a robot arm. In simulation, our approach leads to significant learning speed-ups when compared to standard SAC-X. On the real robot we show that the task can be learned from-scratch, i.e., with no transfer from simulation and no imitation learning. Videos of our learned policies running on the real robot can be found at https://sites.google.com/view/rss-2019-sawyer-bic/.

📄 PDF Abstract BibTeX arXiv:1902.04706

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningReinforcement Learning

MResT: Multi-Resolution Sensing for Real-Time Control with Vision-Language Models

2024-01-25 · Saumya Saxena, Mohit Sharma, Oliver Kroemer

Leveraging sensing modalities across diverse spatial and temporal resolutions can improve performance of robotic manipulation tasks. Multi-spatial resolution sensing provides hierarchical information captured at differen…

Active Vision Reinforcement Learning under Limited Visual Observability

2023-06-01 · NeurIPS 2023 11 · Jinghuan Shang, Michael S. Ryoo

In this work, we investigate Active Vision Reinforcement Learning (ActiveVision-RL), where an embodied agent simultaneously learns action policy for the task while also controlling its visual observations in partially ob…

reinforcement-learning Reinforcement Learning

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

2020-08-03 · Rayan El Helou, Dileep Kalathil, Le Xie

In this paper, we introduce a new framework to address the problem of voltage regulation in unbalanced distribution grids with deep photovoltaic penetration. In this framework, both real and reactive power setpoints are …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing

2022-10-26 · Jiawei Fu, Yunlong Song, Yan Wu, Fisher Yu 외

Autonomous drones can operate in remote and unstructured environments, enabling various real-world applications. However, the lack of effective vision-based algorithms has been a stumbling block to achieving this goal. E…

Contrastive Learning State Estimation Trajectory Planning

From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent

2022-08-09 · Ganghun Lee, Minji Kim, Minsu Lee, Byoung-Tak Zhang

We present an automated learning framework for a robotic sketching agent that is capable of learning stroke-based rendering and motor control simultaneously. We formulate the robotic sketching problem as a deep decoupled…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)