BiRoDiff: Diffusion policies for bipedal robot locomotion on unseen terrains

2024-07-07 · GVS Mothish, Manan Tayal, Shishir Kolathaya

Locomotion on unknown terrains is essential for bipedal robots to handle novel real-world challenges, thus expanding their utility in disaster response and exploration. In this work, we introduce a lightweight framework that learns a single walking controller that yields locomotion on multiple terrains. We have designed a real-time robot controller based on diffusion models, which not only captures multiple behaviours with different velocities in a single policy but also generalizes well for unseen terrains. Our controller learns with offline data, which is better than online learning in aspects like scalability, simplicity in training scheme etc. We have designed and implemented a diffusion model-based policy controller in simulation on our custom-made Bipedal Robot model named Stoch BiRo. We have demonstrated its generalization capability and high frequency control step generation relative to typical generative models, which require huge onboarding compute.

📄 PDF Abstract BibTeX arXiv:2407.05424

Code (0)

등록된 구현이 없습니다.

Tasks

Disaster Response

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots

2021-03-26 · Zhongyu Li, Xuxin Cheng, Xue Bin Peng, Pieter Abbeel 외

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in uns…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Control Policies for Fall prevention and safety in bipedal locomotion

2022-01-04 · Visak Kumar

The ability to recover from an unexpected external perturbation is a fundamental motor skill in bipedal locomotion. An effective response includes the ability to not just recover balance and maintain stability but also t…

Deep Reinforcement Learning

Sim-to-Real Learning for Bipedal Locomotion Under Unsensed Dynamic Loads

2022-04-09 · Jeremy Dao, Kevin Green, Helei Duan, Alan Fern 외

Recent work on sim-to-real learning for bipedal locomotion has demonstrated new levels of robustness and agility over a variety of terrains. However, that work, and most prior bipedal locomotion work, have not considered…

Reinforcement Learning (RL)

Infer and Adapt: Bipedal Locomotion Reward Learning from Demonstrations via Inverse Reinforcement Learning

2023-09-28 · Feiyang Wu, Zhaoyuan Gu, Hanran Wu, Anqi Wu 외

Enabling bipedal walking robots to learn how to maneuver over highly uneven, dynamically changing terrains is challenging due to the complexity of robot dynamics and interacted environments. Recent advancements in learni…

Imitation Learning

Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control

2024-01-30 · Zhongyu Li, Xue Bin Peng, Pieter Abbeel, Sergey Levine 외

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general co…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)