paper-with-me

홈 › Papers

ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces

2024-05-25 · Yusuke Akamatsu, Terumi Umematsu, Hitoshi Imaoka, Shizuko Gomi, Hideo Tsurushima

Daily monitoring of intra-personal facial changes associated with health and emotional conditions has great potential to be useful for medical, healthcare, and emotion recognition fields. However, the approach for capturing intra-personal facial changes is relatively unexplored due to the difficulty of collecting temporally changing face images. In this paper, we propose a facial representation learning method using synthetic images for comparing faces, called ComFace, which is designed to capture intra-personal facial changes. For effective representation learning, ComFace aims to acquire two feature representations, i.e., inter-personal facial differences and intra-personal facial changes. The key point of our method is the use of synthetic face images to overcome the limitations of collecting real intra-personal face images. Facial representations learned by ComFace are transferred to three extensive downstream tasks for comparing faces: estimating facial expression changes, weight changes, and age changes from two face images of the same individual. Our ComFace, trained using only synthetic data, achieves comparable to or better transfer performance than general pre-training and state-of-the-art representation learning methods trained using real images.

📄 PDF Abstract BibTeX arXiv:2405.16016

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion RecognitionRepresentation Learning

Similar Papers 제목 키워드 기반

From Tokens to Faces: Investigating Discrete Speech Representations for 3D Facial Animation

2026-06-11 · Pedro Correa, Olivier Perrotin, Samir Sadok, Paula Costa 외 arxiv

The choice of speech representation is critical in speech-driven 3D facial animation. Representations differ in what they encode: SSL features emphasize segmental and semantic cues, neural codecs yield latents optimized …

Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition

2022-02-10 · Mathias Ibsen, Christian Rathgeb, Pawel Drozdowski, Christoph Busch

Systems that analyse faces have seen significant improvements in recent years and are today used in numerous application scenarios. However, these systems have been found to be negatively affected by facial alterations s…

Deep LearningFace Recognition

FauForensics: Boosting Audio-Visual Deepfake Detection with Facial Action Units

2025-05-13 · Jian Wang, Baoyuan Wu, Li Liu, Qingshan Liu

The rapid evolution of generative AI has increased the threat of realistic audio-visual deepfakes, demanding robust detection methods. Existing solutions primarily address unimodal (audio or visual) forgeries but struggl…

DeepFake DetectionFace Swapping

SynFER: Towards Boosting Facial Expression Recognition with Synthetic Data

2024-10-13 · Xilin He, Cheng Luo, Xiaole Xian, Bing Li 외

Facial expression datasets remain limited in scale due to privacy concerns, the subjectivity of annotations, and the labor-intensive nature of data collection. This limitation poses a significant challenge for developing…

Facial Expression RecognitionPseudo LabelRepresentation Learning

FERAtt: Facial Expression Recognition with Attention Net

2019-02-08 · Pedro D. Marrero Fernandez, Fidel A. Guerrero Peña, Tsang Ing Ren, Alexandre Cunha

We present a new end-to-end network architecture for facial expression recognition with an attention model. It focuses attention in the human face and uses a Gaussian space representation for expression recognition. We d…

DecoderFacial Expression RecognitionFacial Expression Recognition (FER)General Classification