Continual Facial Expression Recognition: A Benchmark
Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual differences in user expression, contextual attributions, and the environment. Current (deep) Machine Learning (ML)-based FER approaches pre-trained in isolation on benchmark datasets fail to capture the nuances of real-world interactions where data is available only incrementally, acquired by the agent or robot during interactions. New learning comes at the cost of previous knowledge, resulting in catastrophic forgetting. Lifelong or Continual Learning (CL), on the other hand, enables adaptability in agents by being sensitive to changing data distributions, integrating new information without interfering with previously learnt knowledge. Positing CL as an effective learning paradigm for FER, this work presents the Continual Facial Expression Recognition (ConFER) benchmark that evaluates popular CL techniques on FER tasks. It presents a comparative analysis of several CL-based approaches on popular FER datasets such as CK+, RAF-DB, and AffectNet and present strategies for a successful implementation of ConFER for Affective Computing (AC) research. CL techniques, under different learning settings, are shown to achieve state-of-the-art (SOTA) performance across several datasets, thus motivating a discussion on the benefits of applying CL principles towards human behaviour understanding, particularly from facial expressions, as well the challenges entailed.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningFacial Expression RecognitionFacial Expression Recognition (FER)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Complex Facial Expression Recognition Using Deep Knowledge Distillation of Basic Features
Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is pa…
Continual LearningEmotion RecognitionFacial Expression RecognitionFew-Shot Learning+1Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic groups. Identifying bias in Machine Learning…
Continual LearningFacial Expression RecognitionFacial Expression Recognition (FER)FairnessAn Ensemble with Shared Representations Based on Convolutional Networks for Continually Learning Facial Expressions
Social robots able to continually learn facial expressions could progressively improve their emotion recognition capability towards people interacting with them. Semi-supervised learning through ensemble predictions is a…
Emotion RecognitionDomain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of aiming at higher individual accuracy scores. Ranging from surveilla…
Continual LearningFacial Expression RecognitionFacial Expression Recognition (FER)Fairness+1Feature Aggregation for Efficient Continual Learning of Complex Facial Expressions
As artificial intelligence (AI) systems become increasingly embedded in our daily life, the ability to recognize and adapt to human emotions is essential for effective human-computer interaction. Facial expression recogn…
Facial Expression RecognitionContinual Learning