paper-with-me

Papers

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

2018-04-27 · Jie Tan, Tingnan Zhang, Erwin Coumans, Atil Iscen, Yunfei Bai, Danijar Hafner, Steven Bohez, Vincent Vanhoucke

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can learn quadruped locomotion from scratch using simple reward signals. In addition, users can provide an open loop reference to guide the learning process when more control over the learned gait is needed. The control policies are learned in a physics simulator and then deployed on real robots. In robotics, policies trained in simulation often do not transfer to the real world. We narrow this reality gap by improving the physics simulator and learning robust policies. We improve the simulation using system identification, developing an accurate actuator model and simulating latency. We learn robust controllers by randomizing the physical environments, adding perturbations and designing a compact observation space. We evaluate our system on two agile locomotion gaits: trotting and galloping. After learning in simulation, a quadruped robot can successfully perform both gaits in the real world.

📄 PDF Abstract BibTeX arXiv:1804.10332

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningReinforcement Learning

Similar Papers 제목 키워드 기반

PALo: Learning Posture-Aware Locomotion for Quadruped Robots

2025-03-06 · Xiangyu Miao, Jun Sun, Hang Lai, Xinpeng Di 외

With the rapid development of embodied intelligence, locomotion control of quadruped robots on complex terrains has become a research hotspot. Unlike traditional locomotion control approaches focusing solely on velocity …

Deep Reinforcement Learning

Evaluation of an Actuated Spine in Agile Quadruped Locomotion

2026-05-08 · Nico Bohlinger, Piotr Kicki, Davide Tateo, Krzysztof Walas 외 arxiv

The spine plays a crucial role in the dynamic locomotion of quadrupedal animals, improving the stability, speed, and efficiency of their gait, especially for fast-paced and highly agile movements. Therefore, the spine is…

Gait in Eight: Efficient On-Robot Learning for Omnidirectional Quadruped Locomotion

2025-03-11 · Nico Bohlinger, Jonathan Kinzel, Daniel Palenicek, Lukasz Antczak 외

On-robot Reinforcement Learning is a promising approach to train embodiment-aware policies for legged robots. However, the computational constraints of real-time learning on robots pose a significant challenge. We presen…

S-Cheetah: A Novel Quadrupedal Robot with a 3-DOF Active Spine Learning Agile Locomotion

2026-05-27 · Zimu Li, Weibang Bai arxiv

The biological spine of quadrupeds enables sagittal flexion/extension, lateral bending, and axial rotation, playing a crucial role in highly agile and dexterous locomotion. While numerous studies have integrated active s…

Reinforcement Learning

SAC-Loco: Safe and Adjustable Compliant Quadrupedal Locomotion

2025-09-27 · Aoqian Zhang, Zixuan Zhuang, Chunzheng Wang, Shuzhi Sam Ge 외 arxiv

Quadruped robots are designed to achieve agile and robust locomotion by drawing inspiration from legged animals. However, most existing control methods for quadruped robots lack a key capacity observed in animals: the ab…

Reinforcement Learning