Data Augmentation for Human Behavior Analysis in Multi-Person Conversations
In this paper, we present the solution of our team HFUT-VUT for the MultiMediate Grand Challenge 2023 at ACM Multimedia 2023. The solution covers three sub-challenges: bodily behavior recognition, eye contact detection, and next speaker prediction. We select Swin Transformer as the baseline and exploit data augmentation strategies to address the above three tasks. Specifically, we crop the raw video to remove the noise from other parts. At the same time, we utilize data augmentation to improve the generalization of the model. As a result, our solution achieves the best results of 0.6262 for bodily behavior recognition in terms of mean average precision and the accuracy of 0.7771 for eye contact detection on the corresponding test set. In addition, our approach also achieves comparable results of 0.5281 for the next speaker prediction in terms of unweighted average recall.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Formal Contracts Mitigate Social Dilemmas in Multi-Agent RL
Multi-agent Reinforcement Learning (MARL) is a powerful tool for training autonomous agents acting independently in a common environment. However, it can lead to sub-optimal behavior when individual incentives and group …
ManagementMulti-agent Reinforcement LearningMulti-Objective Reinforcement Learningreinforcement-learningSimulating Emergent Properties of Human Driving Behavior Using Multi-Agent Reward Augmented Imitation Learning
Recent developments in multi-agent imitation learning have shown promising results for modeling the behavior of human drivers. However, it is challenging to capture emergent traffic behaviors that are observed in real-wo…
Imitation LearningLarge language model as user daily behavior data generator: balancing population diversity and individual personality
Predicting human daily behavior is challenging due to the complexity of routine patterns and short-term fluctuations. While data-driven models have improved behavior prediction by leveraging empirical data from various p…
Data AugmentationDiversityLanguage ModelingLanguage Modelling+3MODA: Motion-Drift Augmentation for Inertial Human Motion Analysis
While data augmentation (DA) has been extensively studied in computer vision, its application to Inertial Measurement Unit (IMU) signals remains largely unexplored, despite IMUs' growing importance in human motion an…
Action RecognitionData AugmentationDomain AdaptationDomain Generalization+4HuBE: Cross-Embodiment Human-like Behavior Execution for Humanoid Robots
Achieving both behavioral similarity and appropriateness in human-like motion generation for humanoid robot remains an open challenge, further compounded by the lack of cross-embodiment adaptability. To address this prob…
Computational EfficiencyData Augmentation