Approximate Optimal Control for Safety-Critical Systems with Control Barrier Functions

2020-08-10

Control Barrier Functions (CBFs) have become a popular tool for enforcing set invariance in safety-critical control systems. While guaranteeing safety, most CBF approaches are myopic in the sense that they solve an optimization problem at each time step rather than over a long time horizon. This approach may allow a system to get too close to the unsafe set where the optimization problem can become infeasible. Some of these issues can be mitigated by introducing relaxation variables into the optimization problem; however, this compromises convergence to the desired equilibrium point. To address these challenges, we develop an approximate optimal approach to the safety-critical control problem in which the cost of violating safety constraints is directly embedded within the value function. We show that our method is capable of guaranteeing both safety and convergence to a desired equilibrium. Finally, we compare the performance of our method with that of the traditional quadratic programming approach through numerical examples.

📄 PDF Abstract BibTeX arXiv:2008.04122

Code (0)

등록된 구현이 없습니다.

Safe Model-Based Reinforcement Learning for Systems with Parametric Uncertainties

2020-07-24 · S M Nahid Mahmud, Scott A Nivison, Zachary I. Bell, Rushikesh Kamalapurkar

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

2024-06-27 · Tochukwu Elijah Ogri, Muzaffar Qureshi, Zachary I. Bell, Rushikesh Kamalapurkar

In this paper, a novel online, output-feedback, critic-only, model-based reinforcement learning framework is developed for safety-critical control systems operating in complex environments. The developed framework ensure…

Model-based Reinforcement Learning State Estimation

Safety aware model-based reinforcement learning for optimal control of a class of output-feedback nonlinear systems

2021-10-01 · S M Nahid Mahmud, Moad Abudia, Scott A Nivison, Zachary I. Bell 외

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirement…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Stochastic Control Barrier Functions with Bayesian Inference for Unknown Stochastic Differential Equations

2023-12-20 · Chuanzheng Wang, Yiming Meng, Jun Liu, Stephen Smith

Control barrier functions are widely used to synthesize safety-critical controls. However, the presence of Gaussian-type noise in dynamical systems can generate unbounded signals and potentially result in severe conseque…

Bayesian Inference

A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems

2025-02-16 · Manan Tayal, Aditya Singh, Shishir Kolathaya, Somil Bansal

As autonomous systems become more ubiquitous in daily life, ensuring high performance with guaranteed safety is crucial. However, safety and performance could be competing objectives, which makes their co-optimization di…

Conformal Prediction Physics-informed machine learning