Safe Reinforcement Learning in a Simulated Robotic Arm

2023-11-28 · Luka Kovač, Igor Farkaš

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages, including safe exploration which will be inevitable in cases when RL systems need to be trained directly in the physical environment (e.g. in human-robot interaction). The popular Safety Gym library offers three mobile agent types that can learn goal-directed tasks while considering various safety constraints. In this paper, we extend the applicability of safe RL algorithms by creating a customized environment with Panda robotic arm where Safety Gym algorithms can be tested. We performed pilot experiments with the popular PPO algorithm comparing the baseline with the constrained version and show that the constrained version is able to learn the equally good policy while better complying with safety constraints and taking longer training time as expected.

📄 PDF Abstract BibTeX arXiv:2312.09468

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe ExplorationSafe Reinforcement Learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Library 설명 없음

Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interaction

2022-09-27 · Puze Liu, Kuo Zhang, Davide Tateo, Snehal Jauhri 외

Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fu…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration+1

OptLayer - Practical Constrained Optimization for Deep Reinforcement Learning in the Real World

2017-09-22 · Tu-Hoa Pham, Giovanni De Magistris, Ryuki Tachibana

While deep reinforcement learning techniques have recently produced considerable achievements on many decision-making problems, their use in robotics has largely been limited to simulated worlds or restricted motions, si…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Reducing Risk for Assistive Reinforcement Learning Policies with Diffusion Models

2024-05-13 · Andrii Tytarenko

Care-giving and assistive robotics, driven by advancements in AI, offer promising solutions to meet the growing demand for care, particularly in the context of increasing numbers of individuals requiring assistance. This…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Guided by Guardrails: Control Barrier Functions as Safety Instructors for Robotic Learning

2025-05-24 · Maeva Guerrier, Karthik Soma, Hassan Fouad, Giovanni Beltrame

Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conv…

Reinforcement Learning (RL)

Meta-Reinforcement Learning for Robotic Industrial Insertion Tasks

2020-04-29 · Gerrit Schoettler, Ashvin Nair, Juan Aparicio Ojea, Sergey Levine 외

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising…

Friction Meta Reinforcement Learning reinforcement-learning Reinforcement Learning+1