Hierarchical Reinforcement Learning for Quadruped Locomotion

2019-05-22 · Deepali Jain, Atil Iscen, Ken Caluwaerts

Legged locomotion is a challenging task for learning algorithms, especially when the task requires a diverse set of primitive behaviors. To solve these problems, we introduce a hierarchical framework to automatically decompose complex locomotion tasks. A high-level policy issues commands in a latent space and also selects for how long the low-level policy will execute the latent command. Concurrently, the low-level policy uses the latent command and only the robot's on-board sensors to control the robot's actuators. Our approach allows the high-level policy to run at a lower frequency than the low-level one. We test our framework on a path-following task for a dynamic quadruped robot and we show that steering behaviors automatically emerge in the latent command space as low-level skills are needed for this task. We then show efficient adaptation of the trained policy to a different task by transfer of the trained low-level policy. Finally, we validate the policies on a real quadruped robot. To the best of our knowledge, this is the first application of end-to-end hierarchical learning to a real robotic locomotion task.

📄 PDF Abstract BibTeX arXiv:1905.08926

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Reinforcement Learning and Value Optimization for Challenging Quadruped Locomotion

2025-06-24 · Jeremiah Coholich, Muhammad Ali Murtaza, Seth Hutchinson, Zsolt Kira

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning

2022-10-10 · Xiaoyu Huang, Zhongyu Li, Yanzhen Xiang, Yiming Ni 외

We present a reinforcement learning (RL) framework that enables quadrupedal robots to perform soccer goalkeeping tasks in the real world. Soccer goalkeeping using quadrupeds is a challenging problem, that combines highly…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Training and Simulation of Quadrupedal Robot in Adaptive Stair Climbing for Indoor Firefighting: An End-to-End Reinforcement Learning Approach

2026-02-03 · Baixiao Huang, Baiyu Huang, Yu Hou arxiv

Quadruped robots are used for primary searches during the early stages of indoor fires. A typical primary search involves quickly and thoroughly looking for victims under hazardous conditions and monitoring flammable mat…

Reinforcement Learning

Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments

2022-09-19 · Mingyo Seo, Ryan Gupta, Yifeng Zhu, Alexy Skoutnev 외

We tackle the problem of perceptive locomotion in dynamic environments. In this problem, a quadrupedal robot must exhibit robust and agile walking behaviors in response to environmental clutter and moving obstacles. We p…

Decision Making Imitation Learning Reinforcement Learning (RL)

MTAC: Hierarchical Reinforcement Learning-based Multi-gait Terrain-adaptive Quadruped Controller

2023-11-01 · Nishaant Shah, Kshitij Tiwari, Aniket Bera

Urban search and rescue missions require rapid first response to minimize loss of life and damage. Often, such efforts are assisted by humanitarian robots which need to handle dynamic operational conditions such as uneve…

Hierarchical Reinforcement Learning Humanitarian reinforcement-learning