Group Activity Recognition using Unreliable Tracked Pose
Group activity recognition in video is a complex task due to the need for a model to recognise the actions of all individuals in the video and their complex interactions. Recent studies propose that optimal performance is achieved by individually tracking each person and subsequently inputting the sequence of poses or cropped images/optical flow into a model. This helps the model to recognise what actions each person is performing before they are merged to arrive at the group action class. However, all previous models are highly reliant on high quality tracking and have only been evaluated using ground truth tracking information. In practice it is almost impossible to achieve highly reliable tracking information for all individuals in a group activity video. We introduce an innovative deep learning-based group activity recognition approach called Rendered Pose based Group Activity Recognition System (RePGARS) which is designed to be tolerant of unreliable tracking and pose information. Experimental results confirm that RePGARS outperforms all existing group activity recognition algorithms tested which do not use ground truth detection and tracking information.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionAllGroup Activity RecognitionOptical Flow EstimationSimilar Papers 제목 키워드 기반
Pose is all you need: The pose only group activity recognition system (POGARS)
We introduce a novel deep learning based group activity recognition approach called the Pose Only Group Activity Recognition System (POGARS), designed to use only tracked poses of people to predict the performed group ac…
Action ClassificationActivity PredictionActivity RecognitionAll+2Two is a crowd: tracking relations in videos
Tracking multiple objects individually differs from tracking groups of related objects. When an object is a part of the group, its trajectory depends on the trajectories of the other group members. Most of the current st…
ObjectRelationVocal Bursts Valence PredictionGroup Activity Recognition Using Joint Learning of Individual Action Recognition and People Grouping
This paper proposes joint learning of individual action recognition and people grouping for improving group activity recognition. By sharing the information between two similar tasks (i.e., individual action recognition …
Action RecognitionActivity RecognitionGroup Activity RecognitionLSTA: Long Short-Term Attention for Egocentric Action Recognition
Egocentric activity recognition is one of the most challenging tasks in video analysis. It requires a fine-grained discrimination of small objects and their manipulation. While some methods base on strong supervision and…
Action RecognitionActivity RecognitionEgocentric Activity RecognitionTemporal Action LocalizationGroup Activity Recognition in Computer Vision: A Comprehensive Review, Challenges, and Future Perspectives
Group activity recognition is a hot topic in computer vision. Recognizing activities through group relationships plays a vital role in group activity recognition. It holds practical implications in various scenarios, suc…
Activity RecognitionGroup Activity Recognition