Agile and versatile bipedal robot tracking control through reinforcement learning

2024-04-12 · Jiayi Li, Linqi Ye, Yi Cheng, Houde Liu, Bin Liang

The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling allows for the execution of both learned and unlearned movements under certain constraints while maintaining balance through minor whole-body coordination. To replicate this balance ability and body agility, this paper proposes a versatile controller for bipedal robots. This controller achieves ankle and body trajectory tracking across a wide range of gaits using a single small-scale neural network, which is based on a model-based IK solver and reinforcement learning. We consider a single step as the smallest control unit and design a universally applicable control input form suitable for any single-step variation. Highly flexible gait control can be achieved by combining these minimal control units with high-level policy through our extensible control interface. To enhance the trajectory-tracking capability of our controller, we utilize a three-stage training curriculum. After training, the robot can move freely between target footholds at varying distances and heights. The robot can also maintain static balance without repeated stepping to adjust posture. Finally, we evaluate the tracking accuracy of our controller on various bipedal tasks, and the effectiveness of our control framework is verified in the simulation environment.

📄 PDF Abstract BibTeX arXiv:2404.08246

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning

Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots

2021-03-26 · Zhongyu Li, Xuxin Cheng, Xue Bin Peng, Pieter Abbeel 외

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in uns…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Control

2022-03-04 · Lizhi Yang, Zhongyu Li, Jun Zeng, Koushil Sreenath

In this paper, we propose a multi-domain control parameter learning framework that combines Bayesian Optimization (BO) and Hybrid Zero Dynamics (HZD) for locomotion control of bipedal robots. We leverage BO to learn the …

Bayesian Optimization valid

Robust and Versatile Bipedal Jumping Control through Reinforcement Learning

2023-02-19 · Zhongyu Li, Xue Bin Peng, Pieter Abbeel, Sergey Levine 외

This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control

2024-01-30 · Zhongyu Li, Xue Bin Peng, Pieter Abbeel, Sergey Levine 외

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general co…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Head Stabilization for Wheeled Bipedal Robots via Force-Estimation-Based Admittance Control

2025-11-24 · Tianyu Wang, Chunxiang Yan, Xuanhong Liao, Tao Zhang 외 arxiv

Wheeled bipedal robots are emerging as flexible platforms for field exploration. However, head instability induced by uneven terrain can degrade the accuracy of onboard sensors or damage fragile payloads. Existing resear…