GiMeFive: Towards Interpretable Facial Emotion Classification
Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here propose our model GiMeFive with interpretations, i.e., via layer activations and gradient-weighted class activation mapping. We compare against the state-of-the-art methods to classify the six facial emotions. Empirical results show that our model outperforms the previous methods in terms of accuracy on two Facial Emotion Recognition (FER) benchmarks and our aggregated FER GiMeFive. Furthermore, we explain our work in real-world image and video examples, as well as real-time live camera streams. Our code and supplementary material are available at https: //github.com/werywjw/SEP-CVDL.
Code (1)
Tasks
ClassificationEmotion ClassificationEmotion RecognitionFacial Emotion RecognitionSimilar Papers 제목 키워드 기반
Interpretable Image Emotion Recognition: A Domain Adaptation Approach Using Facial Expressions
This paper proposes a feature-based domain adaptation technique for identifying emotions in generic images, encompassing both facial and non-facial objects, as well as non-human components. This approach addresses the ch…
Domain AdaptationEmotion ClassificationEmotion RecognitionFacial Emotion Recognition+2Interpretable Multimodal Emotion Recognition using Facial Features and Physiological Signals
This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual…
Emotion ClassificationEmotion RecognitionFeature ImportanceMultimodal Emotion RecognitionInterpretable Explainability in Facial Emotion Recognition and Gamification for Data Collection
Training facial emotion recognition models requires large sets of data and costly annotation processes. To alleviate this problem, we developed a gamified method of acquiring annotated facial emotion data without an expl…
Emotion RecognitionFacial Emotion RecognitionAn Explainable Fast Deep Neural Network for Emotion Recognition
In the context of artificial intelligence, the inherent human attribute of engaging in logical reasoning to facilitate decision-making is mirrored by the concept of explainability, which pertains to the ability of a mode…
AttributeEmotion ClassificationEmotion RecognitionExplainable artificial intelligence+2Music Recommendation Based on Facial Emotion Recognition
Introduction: Music provides an incredible avenue for individuals to express their thoughts and emotions, while also serving as a delightful mode of entertainment for enthusiasts and music lovers. Objectives: This paper …
Emotion ClassificationEmotion RecognitionFacial Emotion RecognitionFacial Expression Recognition+2