Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning
In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents learn solely from sparse rewards while incorporating self-play to iteratively refine their behaviour over time. The robotic manipulator is interfaced using continuous high-level actions for position-based control in the Cartesian plane while having partial observability of the environment with stochastic transitions. We demonstrate that agents are prone to overfitting when trained solely against a single playstyle, highlighting the importance of self-play for generalization to novel strategies of unseen opponents. Furthermore, the impact of the imagination horizon is explored in the competitive setting of the highly dynamic game of air hockey, with longer horizons resulting in more stable learning and better overall performance.
Code (1)
Tasks
Deep Reinforcement LearningPositionSimilar Papers 제목 키워드 기반
Deep Reinforcement Learning in Ice Hockey for Context-Aware Player Evaluation
A variety of machine learning models have been proposed to assess the performance of players in professional sports. However, they have only a limited ability to model how player performance depends on the game context. …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Evaluating deep tracking models for player tracking in broadcast ice hockey video
Tracking and identifying players is an important problem in computer vision based ice hockey analytics. Player tracking is a challenging problem since the motion of players in hockey is fast-paced and non-linear. There i…
Temporal Hockey Action Recognition via Pose and Optical Flows
Recognizing actions in ice hockey using computer vision poses challenges due to bulky equipment and inadequate image quality. A novel two-stream framework has been designed to improve action recognition accuracy for hock…
Action RecognitionOptical Flow EstimationPose EstimationTemporal Action Localization+1Player Tracking and Identification in Ice Hockey
Tracking and identifying players is a fundamental step in computer vision-based ice hockey analytics. The data generated by tracking is used in many other downstream tasks, such as game event detection and game strategy …
Event DetectionMulti-Object TrackingObject TrackingPlayer Identification in Hockey Broadcast Videos
We present a deep recurrent convolutional neural network (CNN) approach to solve the problem of hockey player identification in NHL broadcast videos. Player identification is a difficult computer vision problem mainly be…