Temporal Logic Guided Safe Reinforcement Learning Using Control Barrier Functions

2019-03-23 · Xiao Li, Calin Belta

Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In this paper, we use temporal logic to facilitate specification and learning of complex tasks. We combine temporal logic with control Lyapunov functions to improve exploration. We incorporate control barrier functions to safeguard the exploration and deployment process. We develop a flexible and learnable system that allows users to specify task objectives and constraints in different forms and at various levels. The framework is also able to take advantage of known system dynamics and handle unknown environmental dynamics by integrating model-free learning with model-based planning.

📄 PDF Abstract BibTeX arXiv:1903.09885

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe ExplorationSafe Reinforcement Learning

Control Barrier Function for Linearizable Systems with High Relative Degrees from Signal Temporal Logics: A Reference Governor Approach

2023-09-15 · Kaier Liang, Mingyu Cai, Cristian-Ioan Vasile

This paper considers the safety-critical navigation problem with Signal Temporal Logic (STL) tasks. We developed an explicit reference governor-guided control barrier function (ERG-guided CBF) method that enables the app…

Safeguarding Learning-based Control for Smart Energy Systems with Sampling Specifications

2023-08-11 · Chih-Hong Cheng, Venkatesh Prasad Venkataramanan, Pragya Kirti Gupta, Yun-Fei Hsu 외

We study challenges using reinforcement learning in controlling energy systems, where apart from performance requirements, one has additional safety requirements such as avoiding blackouts. We detail how these safety req…

reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Property-Guided Cyber-Physical Reduction and Surrogation for Safety Analysis in Robotic Vehicles

2025-12-01 · Nazmus Shakib Sayom, Luis Garcia arxiv

We propose a methodology for falsifying safety properties in robotic vehicle systems through property-guided reduction and surrogate execution. By isolating only the control logic and physical dynamics relevant to a give…

Multi-Agent Reinforcement Learning Guided by Signal Temporal Logic Specifications

2023-06-11 · Jiangwei Wang, Shuo Yang, Ziyan An, Songyang Han 외

Reward design is a key component of deep reinforcement learning, yet some tasks and designer's objectives may be unnatural to define as a scalar cost function. Among the various techniques, formal methods integrated with…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Automaton Constrained Q-Learning

2025-10-06 · Anastasios Manganaris, Vittorio Giammarino, Ahmed H. Qureshi arxiv

Real-world robotic tasks often require agents to achieve sequences of goals while respecting time-varying safety constraints. However, standard Reinforcement Learning (RL) paradigms are fundamentally limited in these set…

Reinforcement Learning Continuous Control