Jersey Number Recognition using Keyframe Identification from Low-Resolution Broadcast Videos
Player identification is a crucial component in vision-driven soccer analytics, enabling various downstream tasks such as player assessment, in-game analysis, and broadcast production. However, automatically detecting jersey numbers from player tracklets in videos presents challenges due to motion blur, low resolution, distortions, and occlusions. Existing methods, utilizing Spatial Transformer Networks, CNNs, and Vision Transformers, have shown success in image data but struggle with real-world video data, where jersey numbers are not visible in most of the frames. Hence, identifying frames that contain the jersey number is a key sub-problem to tackle. To address these issues, we propose a robust keyframe identification module that extracts frames containing essential high-level information about the jersey number. A spatio-temporal network is then employed to model spatial and temporal context and predict the probabilities of jersey numbers in the video. Additionally, we adopt a multi-task loss function to predict the probability distribution of each digit separately. Extensive evaluations on the SoccerNet dataset demonstrate that incorporating our proposed keyframe identification module results in a significant 37.81% and 37.70% increase in the accuracies of 2 different test sets with domain gaps. These results highlight the effectiveness and importance of our approach in tackling the challenges of automatic jersey number detection in sports videos.
Code (0)
등록된 구현이 없습니다.
Tasks
Jersey Number RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Domain-Guided Masked Autoencoders for Unique Player Identification
Unique player identification is a fundamental module in vision-driven sports analytics. Identifying players from broadcast videos can aid with various downstream tasks such as player assessment, in-game analysis, and bro…
Sports AnalyticsGeneralized Jersey Number Recognition Using Multi-task Learning With Orientation-guided Weight Refinement
Jersey number recognition (JNR) has always been an important task in sports analytics. Improving recognition accuracy remains an ongoing challenge because images are subject to blurring, occlusion, deformity, and low res…
Jersey Number RecognitionMulti-Task LearningOptical Character RecognitionSports AnalyticsKnock, knock. Who's there? -- Identifying football player jersey numbers with synthetic data
Automatic player identification is an essential and complex task in sports video analysis. Different strategies have been devised over the years, but identification based on jersey numbers is one of the most common appro…
A General Framework for Jersey Number Recognition in Sports Video
Jersey number recognition is an important task in sports video analysis, partly due to its importance for long-term player tracking. It can be viewed as a variant of scene text recognition. However, there is a lack of pu…
Jersey Number RecognitionScene Text RecognitionIce hockey player identification via transformers and weakly supervised learning
Identifying players in video is a foundational step in computer vision-based sports analytics. Obtaining player identities is essential for analyzing the game and is used in downstream tasks such as game event recognitio…
Optical Character RecognitionOptical Character Recognition (OCR)Sports AnalyticsTemporal Sequences+1