Towards Semi-Supervised Deep Facial Expression Recognition with An Adaptive Confidence Margin
Only parts of unlabeled data are selected to train models for most semi-supervised learning methods, whose confidence scores are usually higher than the pre-defined threshold (i.e., the confidence margin). We argue that the recognition performance should be further improved by making full use of all unlabeled data. In this paper, we learn an Adaptive Confidence Margin (Ada-CM) to fully leverage all unlabeled data for semi-supervised deep facial expression recognition. All unlabeled samples are partitioned into two subsets by comparing their confidence scores with the adaptively learned confidence margin at each training epoch: (1) subset I including samples whose confidence scores are no lower than the margin; (2) subset II including samples whose confidence scores are lower than the margin. For samples in subset I, we constrain their predictions to match pseudo labels. Meanwhile, samples in subset II participate in the feature-level contrastive objective to learn effective facial expression features. We extensively evaluate Ada-CM on four challenging datasets, showing that our method achieves state-of-the-art performance, especially surpassing fully-supervised baselines in a semi-supervised manner. Ablation study further proves the effectiveness of our method. The source code is available at https://github.com/hangyu94/Ada-CM.
Code (1)
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Similar Papers 제목 키워드 기반
Semi-Supervised Facial Expression Recognition based on Dynamic Threshold and Negative Learning
Facial expression recognition is a key task in human-computer interaction and affective computing. However, acquiring a large amount of labeled facial expression data is often costly. Therefore, it is particularly import…
Facial Expression RecognitionExploring Large-scale Unlabeled Faces to Enhance Facial Expression Recognition
Facial Expression Recognition (FER) is an important task in computer vision and has wide applications in human-computer interaction, intelligent security, emotion analysis, and other fields. However, the limited size of …
Emotion RecognitionFace RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)LEAF: Unveiling Two Sides of the Same Coin in Semi-supervised Facial Expression Recognition
Semi-supervised learning has emerged as a promising approach to tackle the challenge of label scarcity in facial expression recognition (FER) task. However, current state-of-the-art methods primarily focus on one side of…
Facial Expression RecognitionFacial Expression Recognition (FER)Exploring Facial Expression Recognition through Semi-Supervised Pretraining and Temporal Modeling
Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the upcoming 6th Affective Behavior Analysis…
Facial Expression RecognitionFacial Expression Recognition (FER)SS-MFAR : Semi-supervised Multi-task Facial Affect Recognition
Automatic affect recognition has applications in many areas such as education, gaming, software development, automotives, medical care, etc. but it is non trivial task to achieve appreciable performance on in-the-wild da…
Multi-Task Learning