홈 › Papers

Data-efficient Deep Reinforcement Learning for Dexterous Manipulation

2017-04-10 · ICLR 2018 1 · Ivaylo Popov, Nicolas Heess, Timothy Lillicrap, Roland Hafner, Gabriel Barth-Maron, Matej Vecerik, Thomas Lampe, Yuval Tassa, Tom Erez, Martin Riedmiller

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are difficult to solve using traditional control theory or hand-engineered approaches. One example of such a task is to grasp an object and precisely stack it on another. Solving this difficult and practically relevant problem in the real world is an important long-term goal for the field of robotics. Here we take a step towards this goal by examining the problem in simulation and providing models and techniques aimed at solving it. We introduce two extensions to the Deep Deterministic Policy Gradient algorithm (DDPG), a model-free Q-learning based method, which make it significantly more data-efficient and scalable. Our results show that by making extensive use of off-policy data and replay, it is possible to find control policies that robustly grasp objects and stack them. Further, our results hint that it may soon be feasible to train successful stacking policies by collecting interactions on real robots.

📄 PDF Abstract BibTeX arXiv:1704.03073

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlDeep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge

2024-12-20 · Hengxu Yan, Haoshu Fang, Cewu Lu

Dexterous manipulation has received considerable attention in recent research. Predominantly, existing studies have concentrated on reinforcement learning methods to address the substantial degrees of freedom in hand mov…

reinforcement-learning Reinforcement Learning

The Developments and Challenges towards Dexterous and Embodied Robotic Manipulation: A Survey

2025-07-16 · Gaofeng Li, Ruize Wang, Peisen Xu, Qi Ye 외 arxiv

Achieving human-like dexterous robotic manipulation remains a central goal and a pivotal challenge in robotics. The development of Artificial Intelligence (AI) has allowed rapid progress in robotic manipulation. This sur…

Reinforcement Learning

Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Survey

2025-05-30 · Edgar Welte, Rania Rayyes

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-cent…

Imitation Learning

Multi-Goal Dexterous Hand Manipulation using Probabilistic Model-based Reinforcement Learning

2025-04-30 · Yingzhuo Jiang, Wenjun Huang, Rongdun Lin, Chenyang Miao 외

This paper tackles the challenge of learning multi-goal dexterous hand manipulation tasks using model-based Reinforcement Learning. We propose Goal-Conditioned Probabilistic Model Predictive Control (GC-PMPC) by designin…

Model-based Reinforcement Learning Model Predictive Control

Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration

2026-06-22 · Xinghao Zhu, Zixi Liu, Shalin Jain, Chenran Li 외 arxiv

Dexterous robot manipulation can benefit from the abundance of human demonstrations, but transferring such demonstrations to robot policies remains challenging. We present Contact Wrench Guidance from Human Demonstration…

Reinforcement Learning Robot Manipulation