Safe Reinforcement Learning via Shielding

2017-08-29 · Mohammed Alshiekh, Roderick Bloem, Ruediger Ehlers, Bettina Könighofer, Scott Niekum, Ufuk Topcu

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties expressed in temporal logic. To this end, given the temporal logic specification that is to be obeyed by the learning system, we propose to synthesize a reactive system called a shield. The shield is introduced in the traditional learning process in two alternative ways, depending on the location at which the shield is implemented. In the first one, the shield acts each time the learning agent is about to make a decision and provides a list of safe actions. In the second way, the shield is introduced after the learning agent. The shield monitors the actions from the learner and corrects them only if the chosen action causes a violation of the specification. We discuss which requirements a shield must meet to preserve the convergence guarantees of the learner. Finally, we demonstrate the versatility of our approach on several challenging reinforcement learning scenarios.

📄 PDF Abstract BibTeX arXiv:1708.08611

Code (1)

DanielLSM/safe-rl-tutorial tf

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Safe Multi-Agent Reinforcement Learning via Shielding

2021-01-27 · Ingy Elsayed-Aly, Suda Bharadwaj, Christopher Amato, Rüdiger Ehlers 외

Multi-agent reinforcement learning (MARL) has been increasingly used in a wide range of safety-critical applications, which require guaranteed safety (e.g., no unsafe states are ever visited) during the learning process.…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Approximate Model-Based Shielding for Safe Reinforcement Learning

2023-07-27 · Alexander W. Goodall, Francesco Belardinelli

Reinforcement learning (RL) has shown great potential for solving complex tasks in a variety of domains. However, applying RL to safety-critical systems in the real-world is not easy as many algorithms are sample-ineffic…

Atari Games model reinforcement-learning Reinforcement Learning+2

Do Androids Dream of Electric Fences? Safety-Aware Reinforcement Learning with Latent Shielding

2021-12-21 · Peter He, Borja G. Leon, Francesco Belardinelli

The growing trend of fledgling reinforcement learning systems making their way into real-world applications has been accompanied by growing concerns for their safety and robustness. In recent years, a variety of approach…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe Reinforcement Learning via Probabilistic Logic Shields

2023-03-06 · Wen-Chi Yang, Giuseppe Marra, Gavin Rens, Luc De Raedt

Safe Reinforcement learning (Safe RL) aims at learning optimal policies while staying safe. A popular solution to Safe RL is shielding, which uses a logical safety specification to prevent an RL agent from taking unsafe …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Robust Shielding for Safe Reinforcement Learning

2026-05-29 · Edwin Hamel-De le Court, Thom Badings, Alessandro Abate, Francesco Belardinelli 외 arxiv

Shielding is an effective approach to formally guarantee the safety of reinforcement learning agents in Markov decision processes (MDPs). However, existing shielding techniques typically assume knowledge of the safety-re…

Reinforcement Learning