Safe Exploration in Model-based Reinforcement Learning using Control Barrier Functions

2021-04-16 · Max H. Cohen, Calin Belta

This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs). Our approach is facilitated by the development of a novel class of CBFs, termed Lyapunov-like CBFs (LCBFs), that retain the beneficial properties of CBFs for developing minimally-invasive safe control policies while also possessing desirable Lyapunov-like qualities such as positive semi-definiteness. We show how these LCBFs can be used to augment a learning-based control policy to guarantee safety and then leverage this approach to develop a safe exploration framework in a MBRL setting. We demonstrate that our approach can handle more general safety constraints than comparative methods via numerical examples.

📄 PDF Abstract BibTeX arXiv:2104.08171

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)Safe Exploration

Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey

2024-04-22 · Maeva Guerrier, Hassan Fouad, Giovanni Beltrame

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe…

Lifelong learning reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Safe Exploration in Reinforcement Learning: Training Backup Control Barrier Functions with Zero Training Time Safety Violations

2023-12-13 · Pedram Rabiee, Amirsaeid Safari

This paper introduces the reinforcement learning backup shield (RLBUS), an algorithm that guarantees safe exploration in reinforcement learning (RL) by incorporating backup control barrier functions (BCBFs). RLBUS constr…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration+1

Kernel-Based Safe Exploration in Deep Reinforcement Learning

2026-05-21 · Rupak Majumdar, Nikhil Singh, Sadegh Soudjani arxiv

Safety has been a major concern when deploying deep reinforcement learning algorithms in the real world. A promising direction that ensures that the learned policy does not visit unsafe regions is to learn a \emph{barrie…

Reinforcement Learning Continuous Control

Temporal Logic Guided Safe Reinforcement Learning Using Control Barrier Functions

2019-03-23 · Xiao Li, Calin Belta

Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In t…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration+1

Sample-efficient Safe Learning for Online Nonlinear Control with Control Barrier Functions

2022-07-29 · Wenhao Luo, Wen Sun, Ashish Kapoor

Reinforcement Learning (RL) and continuous nonlinear control have been successfully deployed in multiple domains of complicated sequential decision-making tasks. However, given the exploration nature of the learning proc…

Decision Making Reinforcement Learning (RL)Safe Exploration Sequential Decision Making