Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks
Deep Neural Networks (DNNs) have shown to outperform traditional methods in various visual recognition tasks including Facial Expression Recognition (FER). In spite of efforts made to improve the accuracy of FER systems using DNN, existing methods still are not generalizable enough in practical applications. This paper proposes a 3D Convolutional Neural Network method for FER in videos. This new network architecture consists of 3D Inception-ResNet layers followed by an LSTM unit that together extracts the spatial relations within facial images as well as the temporal relations between different frames in the video. Facial landmark points are also used as inputs to our network which emphasize on the importance of facial components rather than the facial regions that may not contribute significantly to generating facial expressions. Our proposed method is evaluated using four publicly available databases in subject-independent and cross-database tasks and outperforms state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ARPGNet: Appearance- and Relation-aware Parallel Graph Attention Fusion Network for Facial Expression Recognition
The key to facial expression recognition is to learn discriminative spatial-temporal representations that embed facial expression dynamics. Previous studies predominantly rely on pre-trained Convolutional Neural Networks…
Facial Expression RecognitionE2-Capsule Neural Networks for Facial Expression Recognition Using AU-Aware Attention
Capsule neural network is a new and popular technique in deep learning. However, the traditional capsule neural network does not extract features sufficiently before the dynamic routing between the capsules. In this pape…
Facial Expression RecognitionFacial Expression Recognition (FER)Exp-Graph: How Connections Learn Facial Attributes in Graph-based Expression Recognition
Facial expression recognition is crucial for human-computer interaction applications such as face animation, video surveillance, affective computing, medical analysis, etc. Since the structure of facial attributes varies…
Facial Expression RecognitionMulti-Region Ensemble Convolutional Neural Network for Facial Expression Recognition
Facial expressions play an important role in conveying the emotional states of human beings. Recently, deep learning approaches have been applied to image recognition field due to the discriminative power of Convolutiona…
Facial Expression RecognitionFacial Expression Recognition (FER)Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation
Existing facial expression recognition (FER) methods typically fine-tune a pre-trained visual encoder using discrete labels. However, this form of supervision limits to specify the emotional concept of different facial e…
Facial Expression RecognitionFacial Expression Recognition (FER)