Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamics

2019-10-24 · Shuo Li, Osbert Bastani

This paper proposes a framework for safe reinforcement learning that can handle stochastic nonlinear dynamical systems. We focus on the setting where the nominal dynamics are known, and are subject to additive stochastic disturbances with known distribution. Our goal is to ensure the safety of a control policy trained using reinforcement learning, e.g., in a simulated environment. We build on the idea of model predictive shielding (MPS), where a backup controller is used to override the learned policy as needed to ensure safety. The key challenge is how to compute a backup policy in the context of stochastic dynamics. We propose to use a tube-based robust NMPC controller as the backup controller. We estimate the tubes using sampled trajectories, leveraging ideas from statistical learning theory to obtain high-probability guarantees. We empirically demonstrate that our approach can ensure safety in stochastic systems, including cart-pole and a non-holonomic particle with random obstacles.

📄 PDF Abstract BibTeX arXiv:1910.10885

Code (0)

등록된 구현이 없습니다.

Tasks

Learning Theoryreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Safe Reinforcement Learning with Nonlinear Dynamics via Model Predictive Shielding

2019-05-25 · Osbert Bastani

Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

MAMPS: Safe Multi-Agent Reinforcement Learning via Model Predictive Shielding

2019-10-25 · Wenbo Zhang, Osbert Bastani, Vijay Kumar

Reinforcement learning is a promising approach to learning control policies for performing complex multi-agent robotics tasks. However, a policy learned in simulation often fails to guarantee even simple safety propertie…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Approximate Model-Based Shielding for Safe Reinforcement Learning

2023-07-27 · Alexander W. Goodall, Francesco Belardinelli

Reinforcement learning (RL) has shown great potential for solving complex tasks in a variety of domains. However, applying RL to safety-critical systems in the real-world is not easy as many algorithms are sample-ineffic…

Atari Games model reinforcement-learning Reinforcement Learning+2

Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learning

2024-05-22 · Arko Banerjee, Kia Rahmani, Joydeep Biswas, Isil Dillig

Among approaches for provably safe reinforcement learning, Model Predictive Shielding (MPS) has proven effective at complex tasks in continuous, high-dimensional state spaces, by leveraging a backup policy to ensure safe…

reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Robust Shielding for Safe Reinforcement Learning

2026-05-29 · Edwin Hamel-De le Court, Thom Badings, Alessandro Abate, Francesco Belardinelli 외 arxiv

Shielding is an effective approach to formally guarantee the safety of reinforcement learning agents in Markov decision processes (MDPs). However, existing shielding techniques typically assume knowledge of the safety-re…

Reinforcement Learning