State-wise Safe Reinforcement Learning: A Survey

2023-02-06 · WeiYe Zhao, Tairan He, Rui Chen, Tianhao Wei, Changliu Liu

Despite the tremendous success of Reinforcement Learning (RL) algorithms in simulation environments, applying RL to real-world applications still faces many challenges. A major concern is safety, in another word, constraint satisfaction. State-wise constraints are one of the most common constraints in real-world applications and one of the most challenging constraints in Safe RL. Enforcing state-wise constraints is necessary and essential to many challenging tasks such as autonomous driving, robot manipulation. This paper provides a comprehensive review of existing approaches that address state-wise constraints in RL. Under the framework of State-wise Constrained Markov Decision Process (SCMDP), we will discuss the connections, differences, and trade-offs of existing approaches in terms of (i) safety guarantee and scalability, (ii) safety and reward performance, and (iii) safety after convergence and during training. We also summarize limitations of current methods and discuss potential future directions.

📄 PDF Abstract BibTeX arXiv:2302.03122

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Robot ManipulationSafe Reinforcement LearningSurvey

Safe Continual Reinforcement Learning Methods for Nonstationary Environments. Towards a Survey of the State of the Art

2026-01-08 · Timofey Tomashevskiy arxiv

This work provides a state-of-the-art survey of continual safe online reinforcement learning (COSRL) methods. We discuss theoretical aspects, challenges, and open questions in building continual online safe reinforcement…

Reinforcement Learning Continual Learning

Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safety

2021-05-22 · Haitong Ma, Yang Guan, Shegnbo Eben Li, Xiangteng Zhang 외

The safety constraints commonly used by existing safe reinforcement learning (RL) methods are defined only on expectation of initial states, but allow each certain state to be unsafe, which is unsatisfying for real-world…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration+1

State-wise Constrained Policy Optimization

2023-06-21 · WeiYe Zhao, Rui Chen, Yifan Sun, Tianhao Wei 외

Reinforcement Learning (RL) algorithms have shown tremendous success in simulation environments, but their application to real-world problems faces significant challenges, with safety being a major concern. In particular…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Safe Learning and Optimization Techniques: Towards a Survey of the State of the Art

2021-01-23 · Youngmin Kim, Richard Allmendinger, Manuel López-Ibáñez

Safe learning and optimization deals with learning and optimization problems that avoid, as much as possible, the evaluation of non-safe input points, which are solutions, policies, or strategies that cause an irrecovera…

Active Learning Evolutionary Algorithms reinforcement-learning Reinforcement Learning+2

A Survey on Reinforcement Learning Security with Application to Autonomous Driving

2022-12-12 · Ambra Demontis, Maura Pintor, Luca Demetrio, Kathrin Grosse 외

Reinforcement learning allows machines to learn from their own experience. Nowadays, it is used in safety-critical applications, such as autonomous driving, despite being vulnerable to attacks carefully crafted to either…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)