Ice hockey player identification via transformers and weakly supervised learning
Identifying players in video is a foundational step in computer vision-based sports analytics. Obtaining player identities is essential for analyzing the game and is used in downstream tasks such as game event recognition. Transformers are the existing standard in Natural Language Processing (NLP) and are swiftly gaining traction in computer vision. Motivated by the increasing success of transformers in computer vision, in this paper, we introduce a transformer network for recognizing players through their jersey numbers in broadcast National Hockey League (NHL) videos. The transformer takes temporal sequences of player frames (also called player tracklets) as input and outputs the probabilities of jersey numbers present in the frames. The proposed network performs better than the previous benchmark on the dataset used. We implement a weakly-supervised training approach by generating approximate frame-level labels for jersey number presence and use the frame-level labels for faster training. We also utilize player shifts available in the NHL play-by-play data by reading the game time using optical character recognition (OCR) to get the players on the ice rink at a certain game time. Using player shifts improved the player identification accuracy by 6%.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Character RecognitionOptical Character Recognition (OCR)Sports AnalyticsTemporal SequencesWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Player Tracking and Identification in Ice Hockey
Tracking and identifying players is a fundamental step in computer vision-based ice hockey analytics. The data generated by tracking is used in many other downstream tasks, such as game event detection and game strategy …
Event DetectionMulti-Object TrackingObject TrackingPlayer Identification in Hockey Broadcast Videos
We present a deep recurrent convolutional neural network (CNN) approach to solve the problem of hockey player identification in NHL broadcast videos. Player identification is a difficult computer vision problem mainly be…
Evaluating deep tracking models for player tracking in broadcast ice hockey video
Tracking and identifying players is an important problem in computer vision based ice hockey analytics. Player tracking is a challenging problem since the motion of players in hockey is fast-paced and non-linear. There i…
Temporal Hockey Action Recognition via Pose and Optical Flows
Recognizing actions in ice hockey using computer vision poses challenges due to bulky equipment and inadequate image quality. A novel two-stream framework has been designed to improve action recognition accuracy for hock…
Action RecognitionOptical Flow EstimationPose EstimationTemporal Action Localization+1Multi Player Tracking in Ice Hockey with Homographic Projections
Multi Object Tracking (MOT) in ice hockey pursues the combined task of localizing and associating players across a given sequence to maintain their identities. Tracking players from monocular broadcast feeds is an import…
Graph MatchingMulti-Object TrackingObject Tracking