홈 › Papers

Robust Constrained Reinforcement Learning for Continuous Control with Model Misspecification

2020-10-20 · Daniel J. Mankowitz, Dan A. Calian, Rae Jeong, Cosmin Paduraru, Nicolas Heess, Sumanth Dathathri, Martin Riedmiller, Timothy Mann

Many real-world physical control systems are required to satisfy constraints upon deployment. Furthermore, real-world systems are often subject to effects such as non-stationarity, wear-and-tear, uncalibrated sensors and so on. Such effects effectively perturb the system dynamics and can cause a policy trained successfully in one domain to perform poorly when deployed to a perturbed version of the same domain. This can affect a policy's ability to maximize future rewards as well as the extent to which it satisfies constraints. We refer to this as constrained model misspecification. We present an algorithm that mitigates this form of misspecification, and showcase its performance in multiple simulated Mujoco tasks from the Real World Reinforcement Learning (RWRL) suite.

📄 PDF Abstract BibTeX arXiv:2010.10644

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlMuJoCoreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Robust Reinforcement Learning for Continuous Control with Model Misspecification

2019-06-18 · ICLR 2020 1 · Daniel J. Mankowitz, Nir Levine, Rae Jeong, Yuanyuan Shi 외

We provide a framework for incorporating robustness -- to perturbations in the transition dynamics which we refer to as model misspecification -- into continuous control Reinforcement Learning (RL) algorithms. We specifi…

continuous-control Continuous Control MuJoCo reinforcement-learning+2

Safe deep reinforcement learning-based constrained optimal control scheme for active distribution networks

2020-04-15 · Elsevier Applied Energy 2020 4 · Peng Kou, Deliang Liang, Chen Wang, Zihao Wu 외

Reinforcement learning-based schemes are being recently applied for model-free voltage control in active distribution networks. However, existing reinforcement learning methods face challenges when it comes to continuous…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Robust Reinforcement Learning under model misspecification

2021-03-29 · Lebin Yu, Jian Wang, Xudong Zhang

Reinforcement learning has achieved remarkable performance in a wide range of tasks these days. Nevertheless, some unsolved problems limit its applications in real-world control. One of them is model misspecification, a …

Adversarial Attack model reinforcement-learning Reinforcement Learning+1

Reward Constrained Policy Optimization

2018-05-28 · ICLR 2019 5 · Chen Tessler, Daniel J. Mankowitz, Shie Mannor

Solving tasks in Reinforcement Learning is no easy feat. As the goal of the agent is to maximize the accumulated reward, it often learns to exploit loopholes and misspecifications in the reward signal resulting in unwant…

Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Deep reinforcement learning under signal temporal logic constraints using Lagrangian relaxation

2022-01-21 · Junya Ikemoto, Toshimitsu Ushio

Deep reinforcement learning (DRL) has attracted much attention as an approach to solve optimal control problems without mathematical models of systems. On the other hand, in general, constraints may be imposed on optimal…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)