paper-with-me

홈 › Papers

Facial Expression Recognition using Squeeze and Excitation-powered Swin Transformers

2023-01-26 · Arpita Vats, Aman Chadha

The ability to recognize and interpret facial emotions is a critical component of human communication, as it allows individuals to understand and respond to emotions conveyed through facial expressions and vocal tones. The recognition of facial emotions is a complex cognitive process that involves the integration of visual and auditory information, as well as prior knowledge and social cues. It plays a crucial role in social interaction, affective processing, and empathy, and is an important aspect of many real-world applications, including human-computer interaction, virtual assistants, and mental health diagnosis and treatment. The development of accurate and efficient models for facial emotion recognition is therefore of great importance and has the potential to have a significant impact on various fields of study.The field of Facial Emotion Recognition (FER) is of great significance in the areas of computer vision and artificial intelligence, with vast commercial and academic potential in fields such as security, advertising, and entertainment. We propose a FER framework that employs Swin Vision Transformers (SwinT) and squeeze and excitation block (SE) to address vision tasks. The approach uses a transformer model with an attention mechanism, SE, and SAM to improve the efficiency of the model, as transformers often require a large amount of data. Our focus was to create an efficient FER model based on SwinT architecture that can recognize facial emotions using minimal data. We trained our model on a hybrid dataset and evaluated its performance on the AffectNet dataset, achieving an F1-score of 0.5420, which surpassed the winner of the Affective Behavior Analysis in the Wild (ABAW) Competition held at the European Conference on Computer Vision (ECCV) 2022~\cite{Kollias}.

📄 PDF Abstract BibTeX arXiv:2301.10906

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion RecognitionFacial Emotion RecognitionFacial Expression Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition

2021-07-07 · Mouath Aouayeb, Wassim Hamidouche, Catherine Soladie, Kidiyo Kpalma 외

As various databases of facial expressions have been made accessible over the last few decades, the Facial Expression Recognition (FER) task has gotten a lot of interest. The multiple sources of the available databases r…

Facial Expression Recognition (FER)

EmoNeXt: an Adapted ConvNeXt for Facial Emotion Recognition

2025-01-14 · IEEE 25th International Workshop on Multimedia Signal Processing (MMSP) 2023 9 · Yassine El Boudouri, Amine Bohi

Facial expressions play a crucial role in human communication serving as a powerful and impactful means to express a wide range of emotions. With advancements in artificial intelligence and computer vision, deep neural n…

Deep LearningEmotion ClassificationEmotion RecognitionFacial Emotion Recognition+1

A Multi-resolution Approach to Expression Recognition in the Wild

2021-03-09 · Fabio Valerio Massoli, Donato Cafarelli, Giuseppe Amato, Fabrizio Falchi

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual…

Facial Expression RecognitionFacial Expression Recognition (FER)

Achieving 3D Attention via Triplet Squeeze and Excitation Block

2025-05-09 · Maan Alhazmi, Abdulrahman Altahhan

The emergence of ConvNeXt and its variants has reaffirmed the conceptual and structural suitability of CNN-based models for vision tasks, re-establishing them as key players in image classification in general, and in fac…

Facial Expression RecognitionFacial Expression Recognition (FER)image-classificationImage Classification+1

ResEmoteNet: Bridging Accuracy and Loss Reduction in Facial Emotion Recognition

2024-09-01 · Arnab Kumar Roy, Hemant Kumar Kathania, Adhitiya Sharma, Abhishek Dey 외

The human face is a silent communicator, expressing emotions and thoughts through its facial expressions. With the advancements in computer vision in recent years, facial emotion recognition technology has made significa…

Emotion RecognitionFacial Emotion RecognitionFacial Expression Recognition (FER)