Facial Expression Recognition using Squeeze and Excitation-powered Swin Transformers
The ability to recognize and interpret facial emotions is a critical component of human communication, as it allows individuals to understand and respond to emotions conveyed through facial expressions and vocal tones. The recognition of facial emotions is a complex cognitive process that involves the integration of visual and auditory information, as well as prior knowledge and social cues. It plays a crucial role in social interaction, affective processing, and empathy, and is an important aspect of many real-world applications, including human-computer interaction, virtual assistants, and mental health diagnosis and treatment. The development of accurate and efficient models for facial emotion recognition is therefore of great importance and has the potential to have a significant impact on various fields of study.The field of Facial Emotion Recognition (FER) is of great significance in the areas of computer vision and artificial intelligence, with vast commercial and academic potential in fields such as security, advertising, and entertainment. We propose a FER framework that employs Swin Vision Transformers (SwinT) and squeeze and excitation block (SE) to address vision tasks. The approach uses a transformer model with an attention mechanism, SE, and SAM to improve the efficiency of the model, as transformers often require a large amount of data. Our focus was to create an efficient FER model based on SwinT architecture that can recognize facial emotions using minimal data. We trained our model on a hybrid dataset and evaluated its performance on the AffectNet dataset, achieving an F1-score of 0.5420, which surpassed the winner of the Affective Behavior Analysis in the Wild (ABAW) Competition held at the European Conference on Computer Vision (ECCV) 2022~\cite{Kollias}.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionFacial Emotion RecognitionFacial Expression RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition
As various databases of facial expressions have been made accessible over the last few decades, the Facial Expression Recognition (FER) task has gotten a lot of interest. The multiple sources of the available databases r…
Facial Expression Recognition (FER)EmoNeXt: an Adapted ConvNeXt for Facial Emotion Recognition
Facial expressions play a crucial role in human communication serving as a powerful and impactful means to express a wide range of emotions. With advancements in artificial intelligence and computer vision, deep neural n…
Deep LearningEmotion ClassificationEmotion RecognitionFacial Emotion Recognition+1A Multi-resolution Approach to Expression Recognition in the Wild
Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual…
Facial Expression RecognitionFacial Expression Recognition (FER)Achieving 3D Attention via Triplet Squeeze and Excitation Block
The emergence of ConvNeXt and its variants has reaffirmed the conceptual and structural suitability of CNN-based models for vision tasks, re-establishing them as key players in image classification in general, and in fac…
Facial Expression RecognitionFacial Expression Recognition (FER)image-classificationImage Classification+1ResEmoteNet: Bridging Accuracy and Loss Reduction in Facial Emotion Recognition
The human face is a silent communicator, expressing emotions and thoughts through its facial expressions. With the advancements in computer vision in recent years, facial emotion recognition technology has made significa…
Emotion RecognitionFacial Emotion RecognitionFacial Expression Recognition (FER)