ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces
Daily monitoring of intra-personal facial changes associated with health and emotional conditions has great potential to be useful for medical, healthcare, and emotion recognition fields. However, the approach for capturing intra-personal facial changes is relatively unexplored due to the difficulty of collecting temporally changing face images. In this paper, we propose a facial representation learning method using synthetic images for comparing faces, called ComFace, which is designed to capture intra-personal facial changes. For effective representation learning, ComFace aims to acquire two feature representations, i.e., inter-personal facial differences and intra-personal facial changes. The key point of our method is the use of synthetic face images to overcome the limitations of collecting real intra-personal face images. Facial representations learned by ComFace are transferred to three extensive downstream tasks for comparing faces: estimating facial expression changes, weight changes, and age changes from two face images of the same individual. Our ComFace, trained using only synthetic data, achieves comparable to or better transfer performance than general pre-training and state-of-the-art representation learning methods trained using real images.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionRepresentation LearningSimilar Papers 제목 키워드 기반
From Tokens to Faces: Investigating Discrete Speech Representations for 3D Facial Animation
The choice of speech representation is critical in speech-driven 3D facial animation. Representations differ in what they encode: SSL features emphasize segmental and semantic cues, neural codecs yield latents optimized …
Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition
Systems that analyse faces have seen significant improvements in recent years and are today used in numerous application scenarios. However, these systems have been found to be negatively affected by facial alterations s…
Deep LearningFace RecognitionFauForensics: Boosting Audio-Visual Deepfake Detection with Facial Action Units
The rapid evolution of generative AI has increased the threat of realistic audio-visual deepfakes, demanding robust detection methods. Existing solutions primarily address unimodal (audio or visual) forgeries but struggl…
DeepFake DetectionFace SwappingSynFER: Towards Boosting Facial Expression Recognition with Synthetic Data
Facial expression datasets remain limited in scale due to privacy concerns, the subjectivity of annotations, and the labor-intensive nature of data collection. This limitation poses a significant challenge for developing…
Facial Expression RecognitionPseudo LabelRepresentation LearningFERAtt: Facial Expression Recognition with Attention Net
We present a new end-to-end network architecture for facial expression recognition with an attention model. It focuses attention in the human face and uses a Gaussian space representation for expression recognition. We d…
DecoderFacial Expression RecognitionFacial Expression Recognition (FER)General Classification