RMBench: Benchmarking Deep Reinforcement Learning for Robotic Manipulator Control

2022-10-20 · Yanfei Xiang, Xin Wang, Shu Hu, Bin Zhu, Xiaomeng Huang, Xi Wu, Siwei Lyu

Reinforcement learning is applied to solve actual complex tasks from high-dimensional, sensory inputs. The last decade has developed a long list of reinforcement learning algorithms. Recent progress benefits from deep learning for raw sensory signal representation. One question naturally arises: how well do they perform concerning different robotic manipulation tasks? Benchmarks use objective performance metrics to offer a scientific way to compare algorithms. In this paper, we present RMBench, the first benchmark for robotic manipulations, which have high-dimensional continuous action and state spaces. We implement and evaluate reinforcement learning algorithms that directly use observed pixels as inputs. We report their average performance and learning curves to show their performance and stability of training. Our study concludes that none of the studied algorithms can handle all tasks well, soft Actor-Critic outperforms most algorithms in average reward and stability, and an algorithm combined with data augmentation may facilitate learning policies. Our code is publicly available at https://github.com/xiangyanfei212/RMBench-2022, including all benchmark tasks and studied algorithms.

📄 PDF Abstract BibTeX arXiv:2210.11262

Code (1)

xiangyanfei212/RMBench-2022 공식 구현 pytorch

Tasks

Benchmarking Data AugmentationDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

ARMBench: An Object-centric Benchmark Dataset for Robotic Manipulation

2023-03-29 · Chaitanya Mitash, Fan Wang, Shiyang Lu, Vikedo Terhuja 외

This paper introduces Amazon Robotic Manipulation Benchmark (ARMBench), a large-scale, object-centric benchmark dataset for robotic manipulation in the context of a warehouse. Automation of operations in modern warehouse…

Defect Detection Instance Segmentation Object Semantic Segmentation

A Reinforcement Learning Neural Network for Robotic Manipulator Control

2018-07-01 · Conference 2018 7 · Yazhou Hu, Bailu Si

We propose a neural network model for reinforcement learning to control a robotic manipulator with unknown parameters and dead zones. The model is composed of three networks. The state of the robotic manipulator is predi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A New Quaternion-Joint Cable-Driven Redundant Manipulator Configuration and its Control Through FABRIK and Residual Reinforcement Learning

2026-06-03 · Tanapath Pornthisan, Thanapat Kemthong, Thanyapisit Kangsathien, Pasut Aranchaiya 외 arxiv

Robotic arms capable of traversing arbitrary spatial paths, especially in highly obstructed workspaces, are highly desired across several industries. Quaternion-joints have recently empowered a specific class of robotic …

Reinforcement Learning

Reinforcement Learning Tracking Control for Robotic Manipulator With Kernel-Based Dynamic Model

2020-01-09 · TRANSACTION 2020 1 · Yazhou Hu, Wenxue Wang, Hao liu, and Lianqing Liu 외

Reinforcement learning (RL) is an efficient learning approach to solving control problems for a robot by interacting with the environment to acquire the optimal control policy. However, there are many challenges for R…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Towards Vision-Based Deep Reinforcement Learning for Robotic Motion Control

2015-11-12 · Fangyi Zhang, Jürgen Leitner, Michael Milford, Ben Upcroft 외

This paper introduces a machine learning based system for controlling a robotic manipulator with visual perception only. The capability to autonomously learn robot controllers solely from raw-pixel images and without any…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)