Benchmarking Actor-Critic Deep Reinforcement Learning Algorithms for Robotics Control with Action Constraints

2023-04-18 · Kazumi Kasaura, Shuwa Miura, Tadashi Kozuno, Ryo Yonetani, Kenta Hoshino, Yohei Hosoe

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial for ensuring the feasibility and safety of actions in real-world systems. We evaluate existing algorithms and their novel variants across multiple robotics control environments, encompassing multiple action constraint types. Our evaluation provides the first in-depth perspective of the field, revealing surprising insights, including the effectiveness of a straightforward baseline approach. The benchmark problems and associated code utilized in our experiments are made available online at github.com/omron-sinicx/action-constrained-RL-benchmark for further research and development.

📄 PDF Abstract BibTeX arXiv:2304.08743

Code (1)

omron-sinicx/action-constrained-rl-benchmark 공식 구현 pytorch

Tasks

BenchmarkingDeep Reinforcement LearningReinforcement Learning (RL)

Benchmarking Deep Reinforcement Learning Algorithms for Vision-based Robotics

2022-01-11 · Swagat Kumar, Hayden Sampson, Ardhendu Behera

This paper presents a benchmarking study of some of the state-of-the-art reinforcement learning algorithms used for solving two simulated vision-based robotics problems. The algorithms considered in this study include so…

Benchmarking Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

ROS2Learn: a reinforcement learning framework for ROS 2

2019-03-14 · Yue Leire Erro Nuin, Nestor Gonzalez Lopez, Elias Barba Moral, Lander Usategui San Juan 외

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics to train a robot directly from joint states, using traditional robotic tools. We use an state-of-the-art implementation of the Proxim…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Offline Actor-Critic Reinforcement Learning Scales to Large Models

2024-02-08 · Jost Tobias Springenberg, Abbas Abdolmaleki, Jingwei Zhang, Oliver Groth 외

We show that offline actor-critic reinforcement learning can scale to large models - such as transformers - and follows similar scaling laws as supervised learning. We find that offline actor-critic algorithms can outper…

continuous-control Continuous Control Offline RL reinforcement-learning+1

Adviser-Actor-Critic: Eliminating Steady-State Error in Reinforcement Learning Control

2025-02-04 · Donghe Chen, Yubin Peng, Tengjie Zheng, Han Wang 외

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sampl…

Reinforcement Learning (RL)

Actor-Critic Pretraining for Proximal Policy Optimization

2026-02-27 · Andreas Kernbach, Amr Elsheikh, Nicolas Grupp, René Nagel 외 arxiv

Reinforcement learning (RL) actor-critic algorithms enable autonomous learning but often require a large number of environment interactions, which limits their applicability in robotics. Leveraging expert data can reduce…

Reinforcement Learning