paper-with-me

Papers

Guided by Guardrails: Control Barrier Functions as Safety Instructors for Robotic Learning

2025-05-24 · Maeva Guerrier, Karthik Soma, Hassan Fouad, Giovanni Beltrame

Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conventional RL frameworks often model safety by using single scalar negative rewards with immediate episode termination, failing to capture the temporal consequences of unsafe actions (e.g., sustained collision damage). In this work, we introduce a novel approach that simulates these temporal effects by applying continuous negative rewards without episode termination. Our experiments reveal that standard RL methods struggle with this model, as the accumulated negative values in unsafe zones create learning barriers. To address this challenge, we demonstrate how Control Barrier Functions (CBFs), with their proven safety guarantees, effectively help robots avoid catastrophic regions while enhancing learning outcomes. We present three CBF-based approaches, each integrating traditional RL methods with Control Barrier Functions, guiding the agent to learn safe behavior. Our empirical analysis, conducted in both simulated environments and real-world settings using a four-wheel differential drive robot, explores the possibilities of employing these approaches for safe robotic learning.

📄 PDF Abstract BibTeX arXiv:2505.18858

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Safety Guardrails in the Sky: Realizing Control Barrier Functions on the VISTA F-16 Jet

2026-03-29 · Andrew W. Singletary, Max H. Cohen, Tamas G. Molnar, Aaron D. Ames arxiv

The advancement of autonomous systems -- from legged robots to self-driving vehicles and aircraft -- necessitates executing increasingly high-performance and dynamic motions without ever putting the system or its environ…

V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functions

2025-12-11 · Mumuksh Tayal, Manan Tayal, Aditya Singh, Shishir Kolathaya 외 arxiv

Ensuring safety in autonomous systems requires controllers that aim to satisfy state-wise constraints without relying on online interaction.While existing Safe Offline RL methods typically enforce soft expected-cost cons…

Offline RL

Individual Control Barrier Functions-Guided Diffusion Model for Safe Offline Multi-Agent Reinforcement Learning

2026-06-10 · Qingyun Guo, Junyi Shi, Jianuo Huang, Tianyu Shi arxiv

Offline reinforcement learning allows control policies to be learned directly from data without online interaction, making it suitable for safety-critical tasks. Recent studies have applied diffusion models to offline re…

Multi-agent Reinforcement Learning

Control Barrier Corridors: From Safety Functions to Safe Sets

2026-03-06 · Ömür Arslan, Nikolay Atanasov arxiv

Safe autonomy is a critical requirement and a key enabler for robots to operate safely in unstructured complex environments. Control barrier functions and safe motion corridors are two widely used but technically distinc…

Motion Planning

Safety-Critical Control of Stochastic Systems using Stochastic Control Barrier Functions

2021-04-06 · Chuanzheng Wang, Yiming Meng, Stephen L. Smith, Jun Liu

Control barrier functions have been widely used for synthesizing safety-critical controls, often via solving quadratic programs. However, the existence of Gaussian-type noise may lead to unsafe actions and result in seve…