Safety Representations for Safer Policy Learning
Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic consequences. Existing safe exploration methods attempt to mitigate this by imposing constraints, which often result in overly conservative behaviours and inefficient learning. Heavy penalties for early constraint violations can trap agents in local optima, deterring exploration of risky yet high-reward regions of the state space. To address this, we introduce a method that explicitly learns state-conditioned safety representations. By augmenting the state features with these safety representations, our approach naturally encourages safer exploration without being excessively cautious, resulting in more efficient and safer policy learning in safety-critical scenarios. Empirical evaluations across diverse environments show that our method significantly improves task performance while reducing constraint violations during training, underscoring its effectiveness in balancing exploration with safety.
Code (0)
등록된 구현이 없습니다.
Tasks
Safe ExplorationSimilar Papers 제목 키워드 기반
Learning Safe Autonomous Driving Policies Using Predictive Safety Representations
Safe reinforcement learning (SafeRL) is a prominent paradigm for autonomous driving, where agents are required to optimize performance under strict safety requirements. This dual objective creates a fundamental tension, …
Reinforcement LearningAutonomous DrivingSAFER: Data-Efficient and Safe Reinforcement Learning Through Skill Acquisition
Though many reinforcement learning (RL) problems involve learning policies in settings that are difficult to specify safety constraints and sparse rewards, current methods struggle to rapidly and safely acquire successfu…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Robotic Grasping+1SAFER: Data-Efficient and Safe Reinforcement Learning via Skill Acquisition
Methods that extract policy primitives from offline demonstrations using deep generative models have shown promise at accelerating reinforcement learning(RL) for new tasks. Intuitively, these methods should also help to …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Robotic Grasping+1CBF-RL: Safety Filtering Reinforcement Learning in Training with Control Barrier Functions
Reinforcement learning (RL), while powerful and expressive, can often prioritize performance at the expense of safety. Yet safety violations can lead to catastrophic outcomes in real-world deployments. Control Barrier Fu…
Reinforcement LearningSafety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark
Artificial intelligence (AI) systems possess significant potential to drive societal progress. However, their deployment often faces obstacles due to substantial safety concerns. Safe reinforcement learning (SafeRL) emer…
reinforcement-learningReinforcement LearningSafe Reinforcement Learning