Context Aware Group Activity Recognition
This paper addresses the task of group activity recognition in multi-person videos. Existing approaches decompose this task into feature learning and relational reasoning. Despite showing progress, these methods only rely on appearance features for people and overlook the available contextual information, which can play an important role in group activity understanding. In this work, we focus on the feature learning aspect and propose a two-stream architecture that not only considers person-level appearance features, but also makes use of contextual information present in videos for group activity recognition. In particular, we propose to use two types of contextual information beneficial for two different scenarios: pose context and scene context that provide crucial cues for group activity understanding. We combine appearance and contextual features to encode each person with an enriched representation. Finally, these combined features are used in relational reasoning for predicting group activities. We evaluate our method on two benchmarks, Volleyball and Collective Activity and show that joint modeling of contextual information with appearance features benefits in group activity understanding.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionGroup Activity RecognitionRelational ReasoningSimilar Papers 제목 키워드 기반
Group-DINOmics: Incorporating People Dynamics into DINO for Self-supervised Group Activity Feature Learning
This paper proposes Group Activity Feature (GAF) learning without group activity annotations. Unlike prior work, which uses low-level static local features to learn GAFs, we propose leveraging dynamics-aware and group-aw…
GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformer
Group activity recognition is a crucial yet challenging problem, whose core lies in fully exploring spatial-temporal interactions among individuals and generating reasonable group representations. However, previous metho…
Activity RecognitionGroup Activity RecognitionDetector-Free Weakly Supervised Group Activity Recognition
Group activity recognition is the task of understanding the activity conducted by a group of people as a whole in a multi-person video. Existing models for this task are often impractical in that they demand ground-truth…
Activity RecognitionGroup Activity RecognitionRecurrent Modeling of Interaction Context for Collective Activity Recognition
Modeling of high order interactional context, e.g., group interaction, lies in the central of collective/group activity recognition. However, most of the previous activity recognition methods do not offer a flexible and…
Activity RecognitionDescriptiveGroup Activity RecognitionAttentive pooling for Group Activity Recognition
In group activity recognition, hierarchical framework is widely adopted to represent the relationships between individuals and their corresponding group, and has achieved promising performance. However, the existing meth…
Activity RecognitionGroup Activity Recognition