Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition
The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other hand, self-supervised contrastive learning has gained great popularity due to its simple yet effective instance discrimination training strategy, which can potentially circumvent the annotation issue. Nevertheless, there remain inherent disadvantages of instance-level discrimination, which are even more challenging when faced with complicated facial representations. In this paper, we revisit the use of self-supervised contrastive learning and explore three core strategies to enforce expression-specific representations and to minimize the interference from other facial attributes, such as identity and face styling. Experimental results show that our proposed method outperforms the current state-of-the-art self-supervised learning methods, in terms of both categorical and dimensional facial expression recognition tasks.
Code (1)
Tasks
Contrastive LearningFacial Expression RecognitionFacial Expression Recognition (FER)Self-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-supervised Contrastive Learning of Multi-view Facial Expressions
Facial expression recognition (FER) has emerged as an important component of human-computer interaction systems. Despite recent advancements in FER, performance often drops significantly for non-frontal facial images. We…
Contrastive LearningFacial Expression RecognitionFacial Expression Recognition (FER)Unsupervised Facial Expression Representation Learning with Contrastive Local Warping
This paper investigates unsupervised representation learning for facial expression analysis. We think Unsupervised Facial Expression Representation (UFER) deserves exploration and has the potential to address some key ch…
Contrastive LearningFacial Expression RecognitionImage RetrievalRepresentation Learning+2Contrastive Learning of View-Invariant Representations for Facial Expressions Recognition
Although there has been much progress in the area of facial expression recognition (FER), most existing methods suffer when presented with images that have been captured from viewing angles that are non-frontal and subst…
Contrastive LearningFacial Expression RecognitionFacial Expression Recognition (FER)SensitivityMulti-Task Multi-Modal Self-Supervised Learning for Facial Expression Recognition
Human communication is multi-modal; e.g., face-to-face interaction involves auditory signals (speech) and visual signals (face movements and hand gestures). Hence, it is essential to exploit multiple modalities when desi…
Emotion ClassificationEmotion Recognition in ConversationFacial Expression RecognitionSelf-Supervised LearningA Generative Framework for Self-Supervised Facial Representation Learning
Self-supervised representation learning has gained increasing attention for strong generalization ability without relying on paired datasets. However, it has not been explored sufficiently for facial representation. Self…
Contrastive LearningFace VerificationFacial Expression RecognitionFacial Expression Recognition (FER)+1