DeepCPG Policies for Robot Locomotion

2023-02-25 · Aditya M. Deshpande, Eric Hurd, Ali A. Minai, Manish Kumar

Central Pattern Generators (CPGs) form the neural basis of the observed rhythmic behaviors for locomotion in legged animals. The CPG dynamics organized into networks allow the emergence of complex locomotor behaviors. In this work, we take this inspiration for developing walking behaviors in multi-legged robots. We present novel DeepCPG policies that embed CPGs as a layer in a larger neural network and facilitate end-to-end learning of locomotion behaviors in deep reinforcement learning (DRL) setup. We demonstrate the effectiveness of this approach on physics engine-based insectoid robots. We show that, compared to traditional approaches, DeepCPG policies allow sample-efficient end-to-end learning of effective locomotion strategies even in the case of high-dimensional sensor spaces (vision). We scale the DeepCPG policies using a modular robot configuration and multi-agent DRL. Our results suggest that gradual complexification with embedded priors of these policies in a modular fashion could achieve non-trivial sensor and motor integration on a robot platform. These results also indicate the efficacy of bootstrapping more complex intelligent systems from simpler ones based on biological principles. Finally, we present the experimental results for a proof-of-concept insectoid robot system for which DeepCPG learned policies initially using the simulation engine and these were afterwards transferred to real-world robots without any additional fine-tuning.

📄 PDF Abstract BibTeX arXiv:2302.13191

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Deep Reinforcement Learning for Tensegrity Robot Locomotion

2016-09-28 · Marvin Zhang, Xinyang Geng, Jonathan Bruce, Ken Caluwaerts 외

Tensegrity robots, composed of rigid rods connected by elastic cables, have a number of unique properties that make them appealing for use as planetary exploration rovers. However, control of tensegrity robots remains a …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

2018-04-27 · Jie Tan, Tingnan Zhang, Erwin Coumans, Atil Iscen 외

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniqu…

Deep Reinforcement Learning Reinforcement Learning

Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots

2021-03-26 · Zhongyu Li, Xuxin Cheng, Xue Bin Peng, Pieter Abbeel 외

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in uns…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

GenTe: Generative Real-world Terrains for General Legged Robot Locomotion Control

2025-04-14 · Hanwen Wan, Mengkang Li, Donghao Wu, Yebin Zhong 외

Developing bipedal robots capable of traversing diverse real-world terrains presents a fundamental robotics challenge, as existing methods using predefined height maps and static environments fail to address the complexi…

Learning Perceptive Platform Adaptive Locomotion Controllers for Quadrupedal Robots

2026-06-23 · David Rytz, Kim Tien Ly, Ioannis Havoutis arxiv

Universal quadrupedal locomotion remains limited by the difficulty of integrating perception across diverse robot morphologies. State-of-the-art controllers rely on single-robot training or blind policies that omit real-…

Reinforcement Learning