paper-with-me

Papers

Feature Aggregation for Efficient Continual Learning of Complex Facial Expressions

2025-12-13 · Thibault Geoffroy, Myriam Maumy, Lionel Prevost arxiv

As artificial intelligence (AI) systems become increasingly embedded in our daily life, the ability to recognize and adapt to human emotions is essential for effective human-computer interaction. Facial expression recognition (FER) provides a primary channel for inferring affective states, but the dynamic and culturally nuanced nature of emotions requires models that can learn continuously without forgetting prior knowledge. In this work, we propose a hybrid framework for FER in a continual learning setting that mitigates catastrophic forgetting. Our approach integrates two complementary modalities: deep convolutional features and facial Action Units (AUs) derived from the Facial Action Coding System (FACS). The combined representation is modelled through Bayesian Gaussian Mixture Models (BGMMs), which provide a lightweight, probabilistic solution that avoids retraining while offering strong discriminative power. Using the Compound Facial Expression of Emotion (CFEE) dataset, we show that our model can first learn basic expressions and then progressively recognize compound expressions. Experiments demonstrate improved accuracy, stronger knowledge retention, and reduced forgetting. This framework contributes to the development of emotionally intelligent AI systems with applications in education, healthcare, and adaptive user interfaces.

📄 PDF Abstract BibTeX arXiv:2512.12277

Code (0)

등록된 구현이 없습니다.

Tasks

Facial Expression RecognitionContinual Learning

Similar Papers 제목 키워드 기반

Complex Facial Expression Recognition Using Deep Knowledge Distillation of Basic Features

2023-08-11 · Angus Maiden, Bahareh Nakisa

Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is pa…

Continual LearningEmotion RecognitionFacial Expression RecognitionFew-Shot Learning+1

An Ensemble with Shared Representations Based on Convolutional Networks for Continually Learning Facial Expressions

2021-03-05 · Henrique Siqueira, Pablo Barros, Sven Magg, Stefan Wermter

Social robots able to continually learn facial expressions could progressively improve their emotion recognition capability towards people interacting with them. Semi-supervised learning through ensemble predictions is a…

Emotion Recognition

Deep Multi-Facial patches Aggregation Network for Expression Classification from Face Images

2019-09-23 · Amine Djerghri, Ahmed Rachid Hazourli, Alice Othmani

Emotional Intelligence in Human-Computer Interaction has attracted increasing attention from researchers in multidisciplinary research fields including psychology, computer vision, neuroscience, artificial intelligence, …

Data AugmentationEmotional IntelligenceFacial expression generationGeneral Classification

Team RAS in 9th ABAW Competition: Multimodal Compound Expression Recognition Approach

2025-07-02 · Elena Ryumina, Maxim Markitantov, Alexandr Axyonov, Dmitry Ryumin 외 arxiv

Compound Expression Recognition (CER), a subfield of affective computing, aims to detect complex emotional states formed by combinations of basic emotions. In this work, we present a novel zero-shot multimodal approach f…

Scene UnderstandingDomain Adaptation

RAF-AU Database: In-the-Wild Facial Expressions with Subjective Emotion Judgement and Objective AU Annotations

2020-08-12 · Wenjing Yan, Shan Li, Chengtao Que, JiQuan Pei 외

Much of the work on automatic facial expression recognition relies on databases containing a certain number of emotion classes and their exaggerated facial configurations (generally six prototypical facial expressions), …

Facial Expression RecognitionFacial Expression Recognition (FER)Multi-Label LearningOpen-Ended Question Answering