Personalized Feature Translation for Expression Recognition: An Efficient Source-Free Domain Adaptation Method
Facial expression recognition (FER) models are widely used in video-based affective computing applications, such as human-computer interaction and healthcare monitoring. However, deep FER models often struggle with subtle expressions and high inter-subject variability, limiting performance in real-world settings. Source-free domain adaptation (SFDA) has been proposed to personalize a pretrained source model using only unlabeled target data, avoiding privacy, storage, and transmission constraints. We address a particularly challenging setting where source data is unavailable and the target data contains only neutral expressions. Existing SFDA methods are not designed for adaptation from a single target class, while generating non-neutral facial images is often unstable and expensive. To address this, we propose Source-Free Domain Adaptation with Personalized Feature Translation (SFDA-PFT), a lightweight latent-space approach. A translator is first pretrained on source data to map subject-specific style features between subjects while preserving expression information through expression-consistency and style-aware objectives. It is then adapted to neutral target data without source data or image synthesis. By operating in the latent space, SFDA-PFT avoids noisy facial image generation, reduces computation, and learns discriminative embeddings for classification. Experiments on BioVid, StressID, BAH, and Aff-Wild2 show that SFDA-PFT consistently outperforms state-of-the-art SFDA methods in privacy-sensitive FER scenarios. Our code is publicly available at: \href{https://github.com/MasoumehSharafi/SFDA-PFT}{GitHub}.
Code (0)
등록된 구현이 없습니다.
Tasks
Source-Free Domain AdaptationFacial Expression RecognitionImage GenerationSimilar Papers 제목 키워드 기반
Pose-aware Adversarial Domain Adaptation for Personalized Facial Expression Recognition
Current facial expression recognition methods fail to simultaneously cope with pose and subject variations. In this paper, we propose a novel unsupervised adversarial domain adaptation method which can alleviate both var…
DisentanglementDomain AdaptationFacial Expression RecognitionFacial Expression Recognition (FER)Uncertainty-Aware Label Refinement on Hypergraphs for Personalized Federated Facial Expression Recognition
Most facial expression recognition (FER) models are trained on large-scale expression data with centralized learning. Unfortunately, collecting a large amount of centralized expression data is difficult in practice due t…
Facial Expression RecognitionFacial Expression Recognition (FER)Federated LearningPersonalized Federated LearningPre-Trained Convolutional Neural Network Features for Facial Expression Recognition
Facial expression recognition has been an active area in computer vision with application areas including animation, social robots, personalized banking, etc. In this study, we explore the problem of image classification…
ClassificationFacial Expression RecognitionFacial Expression Recognition (FER)General Classification+3A Personalized Affective Memory Neural Model for Improving Emotion Recognition
Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial …
Emotion RecognitionMuSACo: Multimodal Subject-Specific Selection and Adaptation for Expression Recognition with Co-Training
Personalized expression recognition (ER) involves adapting a machine learning model to subject-specific data for improved recognition of expressions with considerable interpersonal variability. Subject-specific ER can be…
Domain Adaptation