Towards Inclusive Face Recognition Through Synthetic Ethnicity Alteration
Numerous studies have shown that existing Face Recognition Systems (FRS), including commercial ones, often exhibit biases toward certain ethnicities due to under-represented data. In this work, we explore ethnicity alteration and skin tone modification using synthetic face image generation methods to increase the diversity of datasets. We conduct a detailed analysis by first constructing a balanced face image dataset representing three ethnicities: Asian, Black, and Indian. We then make use of existing Generative Adversarial Network-based (GAN) image-to-image translation and manifold learning models to alter the ethnicity from one to another. A systematic analysis is further conducted to assess the suitability of such datasets for FRS by studying the realistic skin-tone representation using Individual Typology Angle (ITA). Further, we also analyze the quality characteristics using existing Face image quality assessment (FIQA) approaches. We then provide a holistic FRS performance analysis using four different systems. Our findings pave the way for future research works in (i) developing both specific ethnicity and general (any to any) ethnicity alteration models, (ii) expanding such approaches to create databases with diverse skin tones, (iii) creating datasets representing various ethnicities which further can help in mitigating bias while addressing privacy concerns.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityFace Image QualityFace Image Quality AssessmentFace RecognitionGenerative Adversarial NetworkImage GenerationImage Quality AssessmentImage-to-Image TranslationSimilar Papers 제목 키워드 기반
Compressed Models Decompress Race Biases: What Quantized Models Forget for Fair Face Recognition
With the ever-growing complexity of deep learning models for face recognition, it becomes hard to deploy these systems in real life. Researchers have two options: 1) use smaller models; 2) compress their current models. …
Face RecognitionQuantizationA Comparative Study of Image-to-Image Translation Using GANs for Synthetic Child Race Data
The lack of ethnic diversity in data has been a limiting factor of face recognition techniques in the literature. This is particularly the case for children where data samples are scarce and presents a challenge when see…
DiversityFace RecognitionImage-to-Image TranslationBias and Diversity in Synthetic-based Face Recognition
Synthetic data is emerging as a substitute for authentic data to solve ethical and legal challenges in handling authentic face data. The current models can create real-looking face images of people who do not exist. Howe…
AttributeDiversityFace RecognitionSynthetic Face RecognitionFrequency Matters: Explaining Biases of Face Recognition in the Frequency Domain
Face recognition (FR) models are vulnerable to performance variations across demographic groups. The causes for these performance differences are unclear due to the highly complex deep learning-based structure of face re…
Face RecognitionRobust Sclera Segmentation for Skin-tone Agnostic Face Image Quality Assessment
Face image quality assessment (FIQA) is crucial for obtaining good face recognition performance. FIQA algorithms should be robust and insensitive to demographic factors. The eye sclera has a consistent whitish color in a…
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Quality Assessment