paper-with-me

홈 › Papers

Learning Humanoid Robot Running Skills through Proximal Policy Optimization

2019-10-22 · Luckeciano C. Melo, Marcos R. O. A. Maximo

In the current level of evolution of Soccer 3D, motion control is a key factor in team's performance. Recent works takes advantages of model-free approaches based on Machine Learning to exploit robot dynamics in order to obtain faster locomotion skills, achieving running policies and, therefore, opening a new research direction in the Soccer 3D environment. In this work, we present a methodology based on Deep Reinforcement Learning that learns running skills without any prior knowledge, using a neural network whose inputs are related to robot's dynamics. Our results outperformed the previous state-of-the-art sprint velocity reported in Soccer 3D literature by a significant margin. It also demonstrated improvement in sample efficiency, being able to learn how to run in just few hours. We reported our results analyzing the training procedure and also evaluating the policies in terms of speed, reliability and human similarity. Finally, we presented key factors that lead us to improve previous results and shared some ideas for future work.

📄 PDF Abstract BibTeX arXiv:1910.10620

Code (1)

luckeciano/humanoid-run-ppo 공식 구현

Tasks

Deep Reinforcement LearningReinforcement Learning

Similar Papers 제목 키워드 기반

CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation

2025-12-16 · Sirui Chen, Zi-ang Cao, Zhengyi Luo, Fernando Castañeda 외 arxiv

Recent progress in humanoid robots has unlocked agile locomotion skills, including backflipping, running, and crawling. Yet it remains challenging for a humanoid robot to perform forceful manipulation tasks such as movin…

Data Augmentation

Multi-Gait Learning for Humanoid Robots Using Reinforcement Learning with Selective Adversarial Motion Prior

2026-04-21 · Yuanye Wu, Keyi Wang, Linqi Ye, Boyang Xing arxiv

Learning diverse locomotion skills for humanoid robots in a unified reinforcement learning framework remains challenging due to the conflicting requirements of stability and dynamic expressiveness across different gaits.…

Reinforcement Learning

RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting

2026-04-23 · Yucheng Xin, Jiacheng Bao, Yubo Dong, Xueqian Wang 외 arxiv

Humanoid robots have demonstrated impressive motor skills in a wide range of tasks, yet whole-body control for humanlike long-time, dynamic fighting remains particularly challenging due to the stringent requirements on a…

Cooperative Long Rope Skipping via Multi-Agent Reinforcement Learning

2026-06-06 · Zihao Wang, Shijie Peng, Kerui Wu, Yu Huang 외 arxiv

Humans exhibit remarkable motor agility, enabling a wide range of dynamic skills such as running and jumping, which highlights the great potential of humanoid robots for athletic locomotion. Among athletic sports, long r…

Hierarchical Reinforcement LearningMulti-agent Reinforcement Learning

Generalizable Humanoid Manipulation with 3D Diffusion Policies

2024-10-14 · Yanjie Ze, Zixuan Chen, Wenhao Wang, Tianyi Chen 외

Humanoid robots capable of autonomous operation in diverse environments have long been a goal for roboticists. However, autonomous manipulation by humanoid robots has largely been restricted to one specific scene, primar…

Camera CalibrationPoint Cloud Segmentation