paper-with-me

Papers

Solving the Real Robot Challenge using Deep Reinforcement Learning

2021-09-30 · Robert McCarthy, Francisco Roldan Sanchez, Qiang Wang, David Cordova Bulens, Kevin McGuinness, Noel O'Connor, Stephen J. Redmond

This paper details our winning submission to Phase 1 of the 2021 Real Robot Challenge; a challenge in which a three-fingered robot must carry a cube along specified goal trajectories. To solve Phase 1, we use a pure reinforcement learning approach which requires minimal expert knowledge of the robotic system, or of robotic grasping in general. A sparse, goal-based reward is employed in conjunction with Hindsight Experience Replay to teach the control policy to move the cube to the desired x and y coordinates of the goal. Simultaneously, a dense distance-based reward is employed to teach the policy to lift the cube to the z coordinate (the height component) of the goal. The policy is trained in simulation with domain randomisation before being transferred to the real robot for evaluation. Although performance tends to worsen after this transfer, our best policy can successfully lift the real cube along goal trajectories via an effective pinching grasp. Our approach outperforms all other submissions, including those leveraging more traditional robotic control techniques, and is the first pure learning-based method to solve this challenge.

📄 PDF Abstract BibTeX arXiv:2109.15233

Code (2)

robertmccarthy97/rrc_phase1 공식 구현
wq13552463699/rrc_pos_ori

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Robotic Grasping

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Similar Papers 제목 키워드 기반

Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep Reinforcement Learning Approach

2020-08-24 · Cristian C. Beltran-Hernandez, Damien Petit, Ixchel G. Ramirez-Alpizar, Kensuke Harada

Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex …

Deep Reinforcement LearningPositionreinforcement-learningReinforcement Learning+2

Solving Multi-Goal Robotic Tasks with Decision Transformer

2024-10-08 · Paul Gajewski, Dominik Żurek, Marcin Pietroń, Kamil Faber

Artificial intelligence plays a crucial role in robotics, with reinforcement learning (RL) emerging as one of the most promising approaches for robot control. However, several key challenges hinder its broader applicatio…

Multi-Goal Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Robust Reinforcement Learning-based Autonomous Driving Agent for Simulation and Real World

2020-09-23 · Péter Almási, Róbert Moni, Bálint Gyires-Tóth

Deep Reinforcement Learning (DRL) has been successfully used to solve different challenges, e.g. complex board and computer games, recently. However, solving real-world robotics tasks with DRL seems to be a more difficul…

Autonomous DrivingDeep Reinforcement LearningNavigatereinforcement-learning+1

COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing

2020-11-23 · Zhuo Xu, Wenhao Yu, Alexander Herzog, Wenlong Lu 외

General contact-rich manipulation problems are long-standing challenges in robotics due to the difficulty of understanding complicated contact physics. Deep reinforcement learning (RL) has shown great potential in solvin…

Contact-rich ManipulationDeep Reinforcement LearningReinforcement Learning (RL)Robot Manipulation

Reinforcement Learning Experiments and Benchmark for Solving Robotic Reaching Tasks

2020-11-11 · Pierre Aumjaud, David McAuliffe, Francisco Javier Rodríguez Lera, Philip Cardiff

Reinforcement learning has shown great promise in robotics thanks to its ability to develop efficient robotic control procedures through self-training. In particular, reinforcement learning has been successfully applied …

Positionreinforcement-learningReinforcement LearningReinforcement Learning (RL)