Feature Aggregation for Efficient Continual Learning of Complex Facial Expressions
As artificial intelligence (AI) systems become increasingly embedded in our daily life, the ability to recognize and adapt to human emotions is essential for effective human-computer interaction. Facial expression recognition (FER) provides a primary channel for inferring affective states, but the dynamic and culturally nuanced nature of emotions requires models that can learn continuously without forgetting prior knowledge. In this work, we propose a hybrid framework for FER in a continual learning setting that mitigates catastrophic forgetting. Our approach integrates two complementary modalities: deep convolutional features and facial Action Units (AUs) derived from the Facial Action Coding System (FACS). The combined representation is modelled through Bayesian Gaussian Mixture Models (BGMMs), which provide a lightweight, probabilistic solution that avoids retraining while offering strong discriminative power. Using the Compound Facial Expression of Emotion (CFEE) dataset, we show that our model can first learn basic expressions and then progressively recognize compound expressions. Experiments demonstrate improved accuracy, stronger knowledge retention, and reduced forgetting. This framework contributes to the development of emotionally intelligent AI systems with applications in education, healthcare, and adaptive user interfaces.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Expression RecognitionContinual LearningSimilar Papers 제목 키워드 기반
Complex Facial Expression Recognition Using Deep Knowledge Distillation of Basic Features
Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is pa…
Continual LearningEmotion RecognitionFacial Expression RecognitionFew-Shot Learning+1An Ensemble with Shared Representations Based on Convolutional Networks for Continually Learning Facial Expressions
Social robots able to continually learn facial expressions could progressively improve their emotion recognition capability towards people interacting with them. Semi-supervised learning through ensemble predictions is a…
Emotion RecognitionDeep Multi-Facial patches Aggregation Network for Expression Classification from Face Images
Emotional Intelligence in Human-Computer Interaction has attracted increasing attention from researchers in multidisciplinary research fields including psychology, computer vision, neuroscience, artificial intelligence, …
Data AugmentationEmotional IntelligenceFacial expression generationGeneral ClassificationTeam RAS in 9th ABAW Competition: Multimodal Compound Expression Recognition Approach
Compound Expression Recognition (CER), a subfield of affective computing, aims to detect complex emotional states formed by combinations of basic emotions. In this work, we present a novel zero-shot multimodal approach f…
Scene UnderstandingDomain AdaptationRAF-AU Database: In-the-Wild Facial Expressions with Subjective Emotion Judgement and Objective AU Annotations
Much of the work on automatic facial expression recognition relies on databases containing a certain number of emotion classes and their exaggerated facial configurations (generally six prototypical facial expressions), …
Facial Expression RecognitionFacial Expression Recognition (FER)Multi-Label LearningOpen-Ended Question Answering