Model-based Constrained Reinforcement Learning using Generalized Control Barrier Function

2021-03-02 · Haitong Ma, Jianyu Chen, Shengbo Eben Li, Ziyu Lin, Yang Guan, Yangang Ren, Sifa Zheng

Model information can be used to predict future trajectories, so it has huge potential to avoid dangerous region when implementing reinforcement learning (RL) on real-world tasks, like autonomous driving. However, existing studies mostly use model-free constrained RL, which causes inevitable constraint violations. This paper proposes a model-based feasibility enhancement technique of constrained RL, which enhances the feasibility of policy using generalized control barrier function (GCBF) defined on the distance to constraint boundary. By using the model information, the policy can be optimized safely without violating actual safety constraints, and the sample efficiency is increased. The major difficulty of infeasibility in solving the constrained policy gradient is handled by an adaptive coefficient mechanism. We evaluate the proposed method in both simulations and real vehicle experiments in a complex autonomous driving collision avoidance task. The proposed method achieves up to four times fewer constraint violations and converges 3.36 times faster than baseline constrained RL approaches.

📄 PDF Abstract BibTeX arXiv:2103.01556

Code (1)

mahaitongdae/safe_exp_env 공식 구현

Tasks

Autonomous Driving Collision Avoidance reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Constrained Reinforcement Learning with Smoothed Log Barrier Function

2024-03-21 · Baohe Zhang, Yuan Zhang, Lilli Frison, Thomas Brox 외

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. Ho…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey

2024-04-22 · Maeva Guerrier, Hassan Fouad, Giovanni Beltrame

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe…

Lifelong learning reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Achieving Safe Control Online through Integration of Harmonic Control Lyapunov-Barrier Functions with Unsafe Object-Centric Action Policies

2025-11-18 · Marlow Fawn, Matthias Scheutz arxiv

We propose a method for combining Harmonic Control Lyapunov-Barrier Functions (HCLBFs) derived from Signal Temporal Logic (STL) specifications with any given robot policy to turn an unsafe policy into a safe one with for…

Reinforcement Learning

Zero-Shot, Safe and Time-Efficient UAV Navigation via Potential-Based Reward Shaping, Control Lyapunov and Barrier Functions

2026-05-03 · Ashik Abrar Naeem, Mohammad Ariful Haque arxiv

Autonomous navigation and obstacle avoidance remain a core challenge of modern Unmanned Aerial Vehicles (UAVs). While traditional control methods struggle with the complexity and variability of the environment, reinforce…

Reinforcement Learning

Constrained Reinforcement Learning for Safe Heat Pump Control

2024-09-29 · Baohe Zhang, Lilli Frison, Thomas Brox, Joschka Bödecker

Constrained Reinforcement Learning (RL) has emerged as a significant research area within RL, where integrating constraints with rewards is crucial for enhancing safety and performance across diverse control tasks. In th…

Benchmarking reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)