Affective Behavior Analysis using Action Unit Relation Graph and Multi-task Cross Attention
Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue and requires more research. In this paper, we present our solution and experiment result for the Multi-Task Learning challenge of the Affective Behavior Analysis in-the-wild competition. The challenge is a combination of three tasks: action unit detection, facial expression recognition, and valance-arousal estimation. To address this challenge, we introduce a cross-attentive module to improve multi-task learning performance. Additionally, a facial graph is applied to capture the association among action units. As a result, we achieve the evaluation measure of 128.8 on the validation data provided by the organizers, which outperforms the baseline result of 30.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Unit DetectionArousal EstimationEmotion RecognitionFacial Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Multi-Task LearningRelationSimilar Papers 제목 키워드 기반
Multi-Task Learning for Emotion Descriptors Estimation at the fourth ABAW Challenge
Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition…
Multi-Task LearningMulti-modal Multi-label Facial Action Unit Detection with Transformer
Facial Action Coding System is an important approach of facial expression analysis.This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition. We proposed a transfomer based mode…
Action Unit DetectionFacial Action Unit DetectionFeature Pyramid Network for Multi-task Affective Analysis
Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierar…
Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detection
Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW).…
Action Unit DetectionData AugmentationFacial Action Unit DetectionGraph Neural Network+1Facial Affective Behavior Analysis Method for 5th ABAW Competition
Facial affective behavior analysis is important for human-computer interaction. 5th ABAW competition includes three challenges from Aff-Wild2 database. Three common facial affective analysis tasks are involved, i.e. vale…
Arousal Estimation