Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

2022-08-01 · Yandong Ji, Zhongyu Li, Yinan Sun, Xue Bin Peng, Sergey Levine, Glen Berseth, Koushil Sreenath

We address the problem of enabling quadrupedal robots to perform precise shooting skills in the real world using reinforcement learning. Developing algorithms to enable a legged robot to shoot a soccer ball to a given target is a challenging problem that combines robot motion control and planning into one task. To solve this problem, we need to consider the dynamics limitation and motion stability during the control of a dynamic legged robot. Moreover, we need to consider motion planning to shoot the hard-to-model deformable ball rolling on the ground with uncertain friction to a desired location. In this paper, we propose a hierarchical framework that leverages deep reinforcement learning to train (a) a robust motion control policy that can track arbitrary motions and (b) a planning policy to decide the desired kicking motion to shoot a soccer ball to a target. We deploy the proposed framework on an A1 quadrupedal robot and enable it to accurately shoot the ball to random targets in the real world.

📄 PDF Abstract BibTeX arXiv:2208.01160

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningFrictionHierarchical Reinforcement Learning Motion Planning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Situational Awareness by Risk-Conscious Skills

2016-10-10 · Daniel J. Mankowitz, Aviv Tamar, Shie Mannor

Hierarchical Reinforcement Learning has been previously shown to speed up the convergence rate of RL planning algorithms as well as mitigate feature-based model misspecification (Mankowitz et. al. 2016a,b, Bacon 2015). T…

Hierarchical Reinforcement Learning Reinforcement Learning

Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning

2022-10-10 · Xiaoyu Huang, Zhongyu Li, Yanzhen Xiang, Yiming Ni 외

We present a reinforcement learning (RL) framework that enables quadrupedal robots to perform soccer goalkeeping tasks in the real world. Soccer goalkeeping using quadrupeds is a challenging problem, that combines highly…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

HierKick: Hierarchical Reinforcement Learning for Vision-Guided Soccer Robot Control

2026-03-01 · Yizhi Chen, Zheng Zhang, Zhanxiang Cao, Yihe Chen 외 arxiv

Controlling soccer robots involves multi-time-scale decision-making, which requires balancing long-term tactical planning and short-term motion execution. Traditional end-to-end reinforcement learning (RL) methods face c…

Hierarchical Reinforcement Learning

RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learning

2026-06-09 · Yichao Zhong, Yidan Lu, Yuhang Lu, Tianyang Tang 외 arxiv

Elite humanoid soccer shooting requires whole-body stability, high-impulse whole-body interactions, and accuracy to targets. Motion tracking-driven reinforcement learning (RL) provides stability in whole-body movement co…

Reinforcement Learning

A simple method for decision making in robocup soccer simulation 3d environment

2012-12-07 · Khashayar Niki Maleki, Mohammad Hadi Valipour, Sadegh Mokari, Roohollah Yeylaghi Ashrafi 외

In this paper new hierarchical hybrid fuzzy-crisp methods for decision making and action selection of an agent in soccer simulation 3D environment are presented. First, the skills of an agent are introduced, implemented …

Decision Making Position