Self-supervised Social Relation Representation for Human Group Detection
Human group detection, which splits crowd of people into groups, is an important step for video-based human social activity analysis. The core of human group detection is the human social relation representation and division.In this paper, we propose a new two-stage multi-head framework for human group detection. In the first stage, we propose a human behavior simulator head to learn the social relation feature embedding, which is self-supervisely trained by leveraging the socially grounded multi-person behavior relationship. In the second stage, based on the social relation embedding, we develop a self-attention inspired network for human group detection. Remarkable performance on two state-of-the-art large-scale benchmarks, i.e., PANDA and JRDB-Group, verifies the effectiveness of the proposed framework. Benefiting from the self-supervised social relation embedding, our method can provide promising results with very few (labeled) training data. We will release the source code to the public.
Code (1)
Tasks
RelationSimilar Papers 제목 키워드 기반
Automatic Self-supervised Learning for Social Recommendations
In recent years, researchers have attempted to exploit social relations to improve the performance in recommendation systems. Generally, most existing social recommendation methods heavily depends on substantial domain k…
Meta-LearningRecommendation SystemsRepresentation LearningSelf-Supervised LearningRumor Detection with Self-supervised Learning on Texts and Social Graph
Rumor detection has become an emerging and active research field in recent years. At the core is to model the rumor characteristics inherent in rich information, such as propagation patterns in social network and semanti…
Self-Supervised LearningSocial Recommendation with Self-Supervised Metagraph Informax Network
In recent years, researchers attempt to utilize online social information to alleviate data sparsity for collaborative filtering, based on the rationale that social networks offers the insights to understand the behavior…
Collaborative FilteringGraph Neural NetworkRecommendation SystemsSelf-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation
Social relations are often used to improve recommendation quality when user-item interaction data is sparse in recommender systems. Most existing social recommendation models exploit pairwise relations to mine potential …
Recommendation SystemsSelf-Supervised LearningSelf-supervised 3D Representation Learning of Dressed Humans from Social Media Videos
A key challenge of learning a visual representation for the 3D high fidelity geometry of dressed humans lies in the limited availability of the ground truth data (e.g., 3D scanned models), which results in the performanc…
3D Human ReconstructionDepth EstimationRepresentation LearningSelf-Supervised Learning