Information-Theoretic Bias Assessment Of Learned Representations Of Pretrained Face Recognition
As equality issues in the use of face recognition have garnered a lot of attention lately, greater efforts have been made to debiased deep learning models to improve fairness to minorities. However, there is still no clear definition nor sufficient analysis for bias assessment metrics. We propose an information-theoretic, independent bias assessment metric to identify degree of bias against protected demographic attributes from learned representations of pretrained facial recognition systems. Our metric differs from other methods that rely on classification accuracy or examine the differences between ground truth and predicted labels of protected attributes predicted using a shallow network. Also, we argue, theoretically and experimentally, that logits-level loss is not adequate to explain bias since predictors based on neural networks will always find correlations. Further, we present a synthetic dataset that mitigates the issue of insufficient samples in certain cohorts. Lastly, we establish a benchmark metric by presenting advantages in clear discrimination and small variation comparing with other metrics, and evaluate the performance of different debiased models with the proposed metric.
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionFairnessSimilar Papers 제목 키워드 기반
De-biased Representation Learning for Fairness with Unreliable Labels
Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes co…
FairnessRepresentation LearningAdversarial Scrubbing of Demographic Information for Text Classification
Contextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated target task. We aim to scrub such undesirabl…
Classificationtext-classificationText ClassificationSelf-Supervised Representation Learning From Multi-Domain Data
We present an information-theoretically motivated constraint for self-supervised representation learning from multiple related domains. In contrast to previous self-supervised learning methods, our approach learns from m…
Representation LearningSelf-Supervised LearningTransfer LearningLearning Fair Representations via Rate-Distortion Maximization
Text representations learned by machine learning models often encode undesirable demographic information of the user. Predictive models based on these representations can rely on such information, resulting in biased dec…
AttributeFairnessLearning with Noisy Low-Cost MOS for Image Quality Assessment via Dual-Bias Calibration
Learning based image quality assessment (IQA) models have obtained impressive performance with the help of reliable subjective quality labels, where mean opinion score (MOS) is the most popular choice. However, in view o…
Image Quality Assessment