paper-with-me

Papers

An Energy-Saving Snake Locomotion Gait Policy Obtained Using Deep Reinforcement Learning

2021-03-08 · Yilang Liu, Amir Barati Farimani

Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robots can navigate through the complex environment via the cooperation of multiple motors located on the backbone. However, controlling the robots in an unknown environment is challenging, and conventional control strategies can be energy inefficient or even fail to navigate to the destination. In this work, a snake locomotion gait policy is developed via deep reinforcement learning (DRL) for energy-efficient control. We apply proximal policy optimization (PPO) to each joint motor parameterized by angular velocity and the DRL agent learns the standard serpenoid curve at each timestep. The robot simulator and task environment are built upon PyBullet. Comparing to conventional control strategies, the snake robots controlled by the trained PPO agent can achieve faster movement and more energy-efficient locomotion gait. This work demonstrates that DRL provides an energy-efficient solution for robot control.

📄 PDF Abstract BibTeX arXiv:2103.04511

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Similar Papers 제목 키워드 기반

Locomotion of an Elastic Snake Robot via Natural Dynamics

2026-04-20 · Tristan Ehlert, Arne Sachtler, Annika Schmidt, Davide Calzolari 외 arxiv

Nature suggests that exploiting the elasticities and natural dynamics of robotic systems could increase their locomotion efficiency. Prior work on elastic snake robots supports this hypothesis, but has not fully exploite…

Non-planar snake gaits: from Stigmatic-starts to Sidewinding

2023-03-26 · N. Charles, R. Chelakkot, M. Gazzola, B. Young 외

Of the vast variety of animal gaits, one of the most striking is the non-planar undulating motion of a sidewinder. But non-planar gaits are not limited to sidewinders. Here we report a new non-planar mode used as an esca…

Economic model predictive control for snake robot locomotion

2020-05-22

In this work, the control of snake robot locomotion via economic model predictive control (MPC) is studied. Only very few examples of applications of MPC to snake robots exist and rigorous proofs for recursive feasibilit…

modelModel Predictive Control

Fast and Efficient Locomotion via Learned Gait Transitions

2021-04-09 · Yuxiang Yang, Tingnan Zhang, Erwin Coumans, Jie Tan 외

We focus on the problem of developing energy efficient controllers for quadrupedal robots. Animals can actively switch gaits at different speeds to lower their energy consumption. In this paper, we devise a hierarchical …

Sub--Riemannian boundary value problems for Optimal Geometric Locomotion

2026-02-12 · Oliver Gross, Florine Hartwig, Martin Rumpf, Peter Schröder arxiv

We propose a geometric model for optimal shape-change-induced motions of slender locomotors, e.g., snakes slithering on sand. In these scenarios, the motion of a body in world coordinates is completely determined by the …