Learning Group Activity Features Through Person Attribute Prediction
This paper proposes Group Activity Feature (GAF) learning in which features of multi-person activity are learned as a compact latent vector. Unlike prior work in which the manual annotation of group activities is required for supervised learning, our method learns the GAF through person attribute prediction without group activity annotations. By learning the whole network in an end-to-end manner so that the GAF is required for predicting the person attributes of people in a group, the GAF is trained as the features of multi-person activity. As a person attribute, we propose to use a person's action class and appearance features because the former is easy to annotate due to its simpleness, and the latter requires no manual annotation. In addition, we introduce a location-guided attribute prediction to disentangle the complex GAF for extracting the features of each target person properly. Various experimental results validate that our method outperforms SOTA methods quantitatively and qualitatively on two public datasets. Visualization of our GAF also demonstrates that our method learns the GAF representing fined-grained group activity classes. Code: https://github.com/chihina/GAFL-CVPR2024.
Code (2)
Tasks
AttributePredictionSimilar Papers 제목 키워드 기반
Multi-Level Sequence GAN for Group Activity Recognition
We propose a novel semi-supervised, Multi-Level Sequential Generative Adversarial Network (MLS-GAN) architecture for group activity recognition. In contrast to previous works which utilise manually annotated individual h…
Action ClassificationActivity PredictionActivity RecognitionGeneral Classification+2Context Aware Group Activity Recognition
This paper addresses the task of group activity recognition in multi-person videos. Existing approaches decompose this task into feature learning and relational reasoning. Despite showing progress, these methods only rel…
Activity RecognitionGroup Activity RecognitionRelational ReasoningGroup-DINOmics: Incorporating People Dynamics into DINO for Self-supervised Group Activity Feature Learning
This paper proposes Group Activity Feature (GAF) learning without group activity annotations. Unlike prior work, which uses low-level static local features to learn GAFs, we propose leveraging dynamics-aware and group-aw…
Recurrent Modeling of Interaction Context for Collective Activity Recognition
Modeling of high order interactional context, e.g., group interaction, lies in the central of collective/group activity recognition. However, most of the previous activity recognition methods do not offer a flexible and…
Activity RecognitionDescriptiveGroup Activity RecognitionHunting Group Clues with Transformers for Social Group Activity Recognition
This paper presents a novel framework for social group activity recognition. As an expanded task of group activity recognition, social group activity recognition requires recognizing multiple sub-group activities and ide…
Activity RecognitionGroup Activity Recognition