Constraint-Guided Reinforcement Learning: Augmenting the Agent-Environment-Interaction

2021-04-24 · Helge Spieker

Reinforcement Learning (RL) agents have great successes in solving tasks with large observation and action spaces from limited feedback. Still, training the agents is data-intensive and there are no guarantees that the learned behavior is safe and does not violate rules of the environment, which has limitations for the practical deployment in real-world scenarios. This paper discusses the engineering of reliable agents via the integration of deep RL with constraint-based augmentation models to guide the RL agent towards safe behavior. Within the constraints set, the RL agent is free to adapt and explore, such that its effectiveness to solve the given problem is not hindered. However, once the RL agent leaves the space defined by the constraints, the outside models can provide guidance to still work reliably. We discuss integration points for constraint guidance within the RL process and perform experiments on two case studies: a strictly constrained card game and a grid world environment with additional combinatorial subgoals. Our results show that constraint-guidance does both provide reliability improvements and safer behavior, as well as accelerated training.

📄 PDF Abstract BibTeX arXiv:2104.11918

Code (1)

lcswillems/torch-ac 공식 구현 pytorch

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Risk Sensitive Model-Based Reinforcement Learning using Uncertainty Guided Planning

2021-11-09 · Stefan Radic Webster, Peter Flach

Identifying uncertainty and taking mitigating actions is crucial for safe and trustworthy reinforcement learning agents, especially when deployed in high-risk environments. In this paper, risk sensitivity is promoted in …

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Playing a 2D Game Indefinitely using NEAT and Reinforcement Learning

2022-07-28 · Jerin Paul Selvan, Pravin S. Game

For over a decade now, robotics and the use of artificial agents have become a common thing.Testing the performance of new path finding or search space optimization algorithms has also become a challenge as they require …

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Constrained Policy Gradient Method for Safe and Fast Reinforcement Learning: a Neural Tangent Kernel Based Approach

2021-07-19 · Balázs Varga, Balázs Kulcsár, Morteza Haghir Chehreghani

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be c…

OpenAI Gym

Counterexample-Guided Repair of Reinforcement Learning Systems Using Safety Critics

2024-05-24 · David Boetius, Stefan Leue

Naively trained Deep Reinforcement Learning agents may fail to satisfy vital safety constraints. To avoid costly retraining, we may desire to repair a previously trained reinforcement learning agent to obviate unsafe beh…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning

2026-01-11 · Zhicong Li, Lingjie Jiang, Yulan Hu, Xingchen Zeng 외 arxiv

Critique-guided reinforcement learning (RL) has emerged as a powerful paradigm for training LLM agents by augmenting sparse outcome rewards with natural-language feedback. However, current methods often rely on static or…

Reinforcement Learning