Identifying individual facial expressions by deconstructing a neural network
This paper focuses on the problem of explaining predictions of psychological attributes such as attractiveness, happiness, confidence and intelligence from face photographs using deep neural networks. Since psychological attribute datasets typically suffer from small sample sizes, we apply transfer learning with two base models to avoid overfitting. These models were trained on an age and gender prediction task, respectively. Using a novel explanation method we extract heatmaps that highlight the parts of the image most responsible for the prediction. We further observe that the explanation method provides important insights into the nature of features of the base model, which allow one to assess the aptitude of the base model for a given transfer learning task. Finally, we observe that the multiclass model is more feature rich than its binary counterpart. The experimental evaluation is performed on the 2222 images from the 10k US faces dataset containing psychological attribute labels as well as on a subset of KDEF images.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeGender PredictionTransfer LearningSimilar Papers 제목 키워드 기반
A Data-Theoretic Approach to Identifying Violent Facial Expressions in Social Crime Contexts
Human Facial Expressions plays an important role in identifying human actions or intention. Facial expressions can represent any specific action of any person and the pattern of violent behavior of any person strongly de…
Facial Point Graphs for Amyotrophic Lateral Sclerosis Identification
Identifying Amyotrophic Lateral Sclerosis (ALS) in its early stages is essential for establishing the beginning of treatment, enriching the outlook, and enhancing the overall well-being of those affected individuals. How…
Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online
One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions. In this paper, we present a digital biomarker for PD that utilizes the study of micro-expressions. We analyzed the facial action…
Auditing Facial Emotion Recognition Datasets for Posed Expressions and Racial Bias
Facial expression recognition (FER) algorithms classify facial expressions into emotions such as happy, sad, or angry. An evaluative challenge facing FER algorithms is the fall in performance when detecting spontaneous e…
Facial Expression RecognitionFacial Emotion RecognitionA Multiscale Network with Supervised Contrastive Learning for Real-Time Facial Emotion Recognition
Real-time emotion recognition from facial expressions is a challenging task, particularly in video-based scenarios where multiple emotional states may occur over time. The difficulty increases further due to the fact tha…
Facial Emotion RecognitionContrastive Learning