An Energy-Saving Snake Locomotion Gait Policy Obtained Using Deep Reinforcement Learning
Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robots can navigate through the complex environment via the cooperation of multiple motors located on the backbone. However, controlling the robots in an unknown environment is challenging, and conventional control strategies can be energy inefficient or even fail to navigate to the destination. In this work, a snake locomotion gait policy is developed via deep reinforcement learning (DRL) for energy-efficient control. We apply proximal policy optimization (PPO) to each joint motor parameterized by angular velocity and the DRL agent learns the standard serpenoid curve at each timestep. The robot simulator and task environment are built upon PyBullet. Comparing to conventional control strategies, the snake robots controlled by the trained PPO agent can achieve faster movement and more energy-efficient locomotion gait. This work demonstrates that DRL provides an energy-efficient solution for robot control.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Locomotion of an Elastic Snake Robot via Natural Dynamics
Nature suggests that exploiting the elasticities and natural dynamics of robotic systems could increase their locomotion efficiency. Prior work on elastic snake robots supports this hypothesis, but has not fully exploite…
Non-planar snake gaits: from Stigmatic-starts to Sidewinding
Of the vast variety of animal gaits, one of the most striking is the non-planar undulating motion of a sidewinder. But non-planar gaits are not limited to sidewinders. Here we report a new non-planar mode used as an esca…
Economic model predictive control for snake robot locomotion
In this work, the control of snake robot locomotion via economic model predictive control (MPC) is studied. Only very few examples of applications of MPC to snake robots exist and rigorous proofs for recursive feasibilit…
modelModel Predictive ControlFast and Efficient Locomotion via Learned Gait Transitions
We focus on the problem of developing energy efficient controllers for quadrupedal robots. Animals can actively switch gaits at different speeds to lower their energy consumption. In this paper, we devise a hierarchical …
Sub--Riemannian boundary value problems for Optimal Geometric Locomotion
We propose a geometric model for optimal shape-change-induced motions of slender locomotors, e.g., snakes slithering on sand. In these scenarios, the motion of a body in world coordinates is completely determined by the …