Context-Aware Emotion Recognition Networks
Traditional techniques for emotion recognition have focused on the facial expression analysis only, thus providing limited ability to encode context that comprehensively represents the emotional responses. We present deep networks for context-aware emotion recognition, called CAER-Net, that exploit not only human facial expression but also context information in a joint and boosting manner. The key idea is to hide human faces in a visual scene and seek other contexts based on an attention mechanism. Our networks consist of two sub-networks, including two-stream encoding networks to seperately extract the features of face and context regions, and adaptive fusion networks to fuse such features in an adaptive fashion. We also introduce a novel benchmark for context-aware emotion recognition, called CAER, that is more appropriate than existing benchmarks both qualitatively and quantitatively. On several benchmarks, CAER-Net proves the effect of context for emotion recognition. Our dataset is available at http://caer-dataset.github.io.
Code (1)
Tasks
Emotion ClassificationEmotion RecognitionEmotion Recognition in ContextSimilar Papers 제목 키워드 기반
Salience Adjustment for Context-Based Emotion Recognition
Emotion recognition in dynamic social contexts requires an understanding of the complex interaction between facial expressions and situational cues. This paper presents a salience-adjusted framework for context-aware emo…
Emotion RecognitionDo You Know My Emotion? Emotion-Aware Strategy Recognition towards a Persuasive Dialogue System
Persuasive strategy recognition task requires the system to recognize the adopted strategy of the persuader according to the conversation. However, previous methods mainly focus on the contextual information, little is k…
Self context-aware emotion perception on human-robot interaction
Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recogniti…
Emotion RecognitionContextual Emotion Recognition Using Transformer-Based Models
In order to increase the precision of emotion identification in text, this research suggests a context-aware emotion recognition system employing transformer models, especially BERT. The model is able to comprehend compl…
Emotion RecognitionLanguage ModellingSentiment AnalysisEmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principle
We present EmotiCon, a learning-based algorithm for context-aware perceived human emotion recognition from videos and images. Motivated by Frege's Context Principle from psychology, our approach combines three interpreta…
Emotion RecognitionEmotion Recognition in ContextMultimodal Emotion Recognition