Learning to Amend Facial Expression Representation via De-albino and Affinity
Facial Expression Recognition (FER) is a classification task that points to face variants. Hence, there are certain affinity features between facial expressions, receiving little attention in the FER literature. Convolution padding, despite helping capture the edge information, causes erosion of the feature map simultaneously. After multi-layer filling convolution, the output feature map named albino feature definitely weakens the representation of the expression. To tackle these challenges, we propose a novel architecture named Amending Representation Module (ARM). ARM is a substitute for the pooling layer. Theoretically, it can be embedded in the back end of any network to deal with the Padding Erosion. ARM efficiently enhances facial expression representation from two different directions: 1) reducing the weight of eroded features to offset the side effect of padding, and 2) decomposing facial features to simplify representation learning. Experiments on public benchmarks prove that our ARM boosts the performance of FER remarkably. The validation accuracies are respectively 90.42% on RAF-DB, 65.2% on Affect-Net, and 58.71% on SFEW, exceeding current state-of-the-art methods. Our implementation and trained models are available at https://github.com/JiaweiShiCV/Amend-Representation-Module.
Code (1)
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Representation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Label Distribution Amendment with Emotional Semantic Correlations for Facial Expression Recognition
By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one-…
Facial Expression RecognitionFacial Expression Recognition (FER)Evaluation Scheme of Focal Translation for Japanese Partially Amended Statutes
For updating the translations of Japanese statutes based on their amendments, we need to consider the translation “focality;” that is, we should only modify expressions that are relevant to the amendment and retain the o…
TranslationFerNeXt: Facial Expression Recognition Using ConvNeXt with Channel Attention
Facial expression recognition has contributed significantly to various domains of life from healthcare and education to marketing and sales. This has led to extensive research in trying to improve recognition methods usi…
Deep LearningEmotion ClassificationEmotion RecognitionFacial Emotion Recognition+3Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation
Existing facial expression recognition (FER) methods typically fine-tune a pre-trained visual encoder using discrete labels. However, this form of supervision limits to specify the emotional concept of different facial e…
Facial Expression RecognitionFacial Expression Recognition (FER)Facial Expression Recognition Using Disentangled Adversarial Learning
The representation used for Facial Expression Recognition (FER) usually contain expression information along with other variations such as identity and illumination. In this paper, we propose a novel Disentangled Express…
DecoderFacial Expression RecognitionFacial Expression Recognition (FER)Generative Adversarial Network+2