Beard Segmentation and Recognition Bias
A person's facial hairstyle, such as presence and size of beard, can significantly impact face recognition accuracy. There are publicly-available deep networks that achieve reasonable accuracy at binary attribute classification, such as beard / no beard, but few if any that segment the facial hair region. To investigate the effect of facial hair in a rigorous manner, we first created a set of fine-grained facial hair annotations to train a segmentation model and evaluate its accuracy across African-American and Caucasian face images. We then use our facial hair segmentations to categorize image pairs according to the degree of difference or similarity in the facial hairstyle. We find that the False Match Rate (FMR) for image pairs with different categories of facial hairstyle varies by a factor of over 10 for African-American males and over 25 for Caucasian males. To reduce the bias across image pairs with different facial hairstyles, we propose a scheme for adaptive thresholding based on facial hairstyle similarity. Evaluation on a subject-disjoint set of images shows that adaptive similarity thresholding based on facial hairstyles of the image pair reduces the ratio between the highest and lowest FMR across facial hairstyle categories for African-American from 10.7 to 1.8 and for Caucasians from 25.9 to 1.3. Facial hair annotations and facial hair segmentation model will be publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeFace RecognitionSegmentationSimilar Papers 제목 키워드 기반
Logical Consistency and Greater Descriptive Power for Facial Hair Attribute Learning
Face attribute research has so far used only simple binary attributes for facial hair; e.g., beard / no beard. We have created a new, more descriptive facial hair annotation scheme and applied it to create a new facial h…
AttributeDescriptiveFace RecognitionCan the accuracy bias by facial hairstyle be reduced through balancing the training data?
Appearance of a face can be greatly altered by growing a beard and mustache. The facial hairstyles in a pair of images can cause marked changes to the impostor distribution and the genuine distribution. Also, different d…
Data AugmentationFace RecognitionBEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptation
Automatic Speech Recognition (ASR) systems, despite large multilingual training, struggle in low-resource scenarios where labeled data is scarce. We propose BEARD (BEST-RQ Encoder Adaptation with Re-training and Distilla…
Self-Supervised LearningKnowledge DistillationSpeech RecognitionDomain AdaptationBearded Dragon Activity Recognition Pipeline: An AI-Based Approach to Behavioural Monitoring
Traditional monitoring of bearded dragon (Pogona Viticeps) behaviour is time-consuming and prone to errors. This project introduces an automated system for real-time video analysis, using You Only Look Once (YOLO) object…
Activity RecognitionObject DetectionBEARD: Benchmarking the Adversarial Robustness for Dataset Distillation
Dataset Distillation (DD) is an emerging technique that compresses large-scale datasets into significantly smaller synthesized datasets while preserving high test performance and enabling the efficient training of large …
Adversarial AttackAdversarial RobustnessBenchmarkingDataset Distillation