Make Bipedal Robots Learn How to Imitate
Bipedal robots do not perform well as humans since they do not learn to walk like we do. In this paper we propose a method to train a bipedal robot to perform some basic movements with the help of imitation learning (IL) in which an instructor will perform the movement and the robot will try to mimic the instructor movement. To the best of our knowledge, this is the first time we train the robot to perform movements with a single video of the instructor and as the training is done based on joint angles the robot will keep its joint angles always in physical limits which in return help in faster training. The joints of the robot are identified by OpenPose architecture and then joint angle data is extracted with the help of angle between three points resulting in a noisy solution. We smooth the data using Savitzky-Golay filter and preserve the Simulatore data anatomy. An ingeniously written Deep Q Network (DQN) is trained with experience replay to make the robot learn to perform the movements as similar as the instructor. The implementation of the paper is made publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyImitation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Control Policies for Fall prevention and safety in bipedal locomotion
The ability to recover from an unexpected external perturbation is a fundamental motor skill in bipedal locomotion. An effective response includes the ability to not just recover balance and maintain stability but also t…
Deep Reinforcement LearningMEVITA: Open-Source Bipedal Robot Assembled from E-Commerce Components via Sheet Metal Welding
Various bipedal robots have been developed to date, and in recent years, there has been a growing trend toward releasing these robots as open-source platforms. This shift is fostering an environment in which anyone can f…
Reinforcement LearningHuman Imitated Bipedal Locomotion with Frequency Based Gait Generator Network
Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proxi…
Reinforcement LearningAutonomous Navigation of Underactuated Bipedal Robots in Height-Constrained Environments
Navigating a large-scaled robot in unknown and cluttered height-constrained environments is challenging. Not only is a fast and reliable planning algorithm required to go around obstacles, the robot should also be able t…
Autonomous NavigationTrajectory PlanningLearning Bipedal Walking for Humanoid Robots in Challenging Environments with Obstacle Avoidance
Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this …
Deep Reinforcement Learningreinforcement-learningReinforcement Learning