Facial Affect Estimation in the Wild Using Deep Residual and Convolutional Networks
Automated affective computing in the wild is a challenging task in the field of computer vision. This paper presents three neural network-based methods proposed for the task of facial affect estimation submitted to the First Affect-in-the-Wild challenge. These methods are based on Inception-ResNet modules redesigned specifically for the task of facial affect estimation. These methods are: Shallow Inception-ResNet, Deep Inception-ResNet, and Inception-ResNet with LSTMs. These networks extract facial features in different scales and simultaneously estimate both the valence and arousal in each frame. Root Mean Square Error (RMSE) rates of 0.4 and 0.3 are achieved for the valence and arousal respectively with corresponding Concordance Correlation Coefficient (CCC) rates of 0.04 and 0.29 using Deep Inception-ResNet method.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
BReG-NeXt: Facial Affect Computing Using Adaptive Residual Networks With Bounded Gradient
This paper introduces BReG-NeXt, a residual-based network architecture using a function wtih bounded derivative instead of a simple shortcut path (a.k.a. identity mapping) in the residual units for automatic recognition …
Facial Expression RecognitionFacial Expression Recognition (FER)Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networks
Ensemble methods, traditionally built with independently trained de-correlated models, have proven to be efficient methods for reducing the remaining residual generalization error, which results in robust and accurate me…
DiversityFacial Expression RecognitionFacial Expression Recognition (FER)SS-MFAR : Semi-supervised Multi-task Facial Affect Recognition
Automatic affect recognition has applications in many areas such as education, gaming, software development, automotives, medical care, etc. but it is non trivial task to achieve appreciable performance on in-the-wild da…
Multi-Task LearningTwo-stage Convolutional Part Heatmap Regression for the 1st 3D Face Alignment in the Wild (3DFAW) Challenge
This paper describes our submission to the 1st 3D Face Alignment in the Wild (3DFAW) Challenge. Our method builds upon the idea of convolutional part heatmap regression [1], extending it for 3D face alignment. Our method…
3D Face AlignmentDepth EstimationFace AlignmentregressionMulti-modal Affect Analysis using standardized data within subjects in the Wild
Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affe…
Time SeriesTime Series Analysis