paper-with-me

홈 › Papers

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning

2024-10-29 · Jianlan Luo, Charles Xu, Jeffrey Wu, Sergey Levine

Reinforcement learning (RL) holds great promise for enabling autonomous acquisition of complex robotic manipulation skills, but realizing this potential in real-world settings has been challenging. We present a human-in-the-loop vision-based RL system that demonstrates impressive performance on a diverse set of dexterous manipulation tasks, including dynamic manipulation, precision assembly, and dual-arm coordination. Our approach integrates demonstrations and human corrections, efficient RL algorithms, and other system-level design choices to learn policies that achieve near-perfect success rates and fast cycle times within just 1 to 2.5 hours of training. We show that our method significantly outperforms imitation learning baselines and prior RL approaches, with an average 2x improvement in success rate and 1.8x faster execution. Through extensive experiments and analysis, we provide insights into the effectiveness of our approach, demonstrating how it learns robust, adaptive policies for both reactive and predictive control strategies. Our results suggest that RL can indeed learn a wide range of complex vision-based manipulation policies directly in the real world within practical training times. We hope this work will inspire a new generation of learned robotic manipulation techniques, benefiting both industrial applications and research advancements. Videos and code are available at our project website https://hil-serl.github.io/.

📄 PDF Abstract BibTeX arXiv:2410.21845

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

HERMES: Human-to-Robot Embodied Learning from Multi-Source Motion Data for Mobile Dexterous Manipulation

2025-08-27 · Zhecheng Yuan, Tianming Wei, Langzhe Gu, Pu Hua 외 arxiv

Leveraging human motion data to impart robots with versatile manipulation skills has emerged as a promising paradigm in robotic manipulation. Nevertheless, translating multi-source human hand motions into feasible robot …

Reinforcement Learning

Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Survey

2025-05-30 · Edgar Welte, Rania Rayyes

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-cent…

Imitation Learning

MAPLE: Encoding Dexterous Robotic Manipulation Priors Learned From Egocentric Videos

2025-04-08 · Alexey Gavryushin, Xi Wang, Robert J. S. Malate, Chenyu Yang 외

Large-scale egocentric video datasets capture diverse human activities across a wide range of scenarios, offering rich and detailed insights into how humans interact with objects, especially those that require fine-grain…

Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration

2026-06-22 · Xinghao Zhu, Zixi Liu, Shalin Jain, Chenran Li 외 arxiv

Dexterous robot manipulation can benefit from the abundance of human demonstrations, but transferring such demonstrations to robot policies remains challenging. We present Contact Wrench Guidance from Human Demonstration…

Reinforcement LearningRobot Manipulation

ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning

2025-03-27 · CVPR 2025 1 · Kailin Li, Puhao Li, Tengyu Liu, Yuyang Li 외

Human hands play a central role in interacting, motivating increasing research in dexterous robotic manipulation. Data-driven embodied AI algorithms demand precise, large-scale, human-like manipulation sequences, which a…