Demographic Fairness in Face Identification: The Watchlist Imbalance Effect
Recently, different researchers have found that the gallery composition of a face database can induce performance differentials to facial identification systems in which a probe image is compared against up to all stored reference images to reach a biometric decision. This negative effect is referred to as "watchlist imbalance effect". In this work, we present a method to theoretically estimate said effect for a biometric identification system given its verification performance across demographic groups and the composition of the used gallery. Further, we report results for identification experiments on differently composed demographic subsets, i.e. females and males, of the public academic MORPH database using the open-source ArcFace face recognition system. It is shown that the database composition has a huge impact on performance differentials in biometric identification systems, even if performance differentials are less pronounced in the verification scenario. This study represents the first detailed analysis of the watchlist imbalance effect which is expected to be of high interest for future research in the field of facial recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Face IdentificationFace RecognitionFairnessMORPHMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Risk Assessment in the Face-based Watchlist Screening in e-Border
This paper concerns with facial-based watchlist technology as a component of automated border control machines deployed in e-borders. The key task of the watchlist technology is to mitigate effects of mis-identification …
Watchlist Challenge: 3rd Open-set Face Detection and Identification
In the current landscape of biometrics and surveillance, the ability to accurately recognize faces in uncontrolled settings is paramount. The Watchlist Challenge addresses this critical need by focusing on face detection…
Face DetectionFace RecognitionFairness Index Measures to Evaluate Bias in Biometric Recognition
The demographic disparity of biometric systems has led to serious concerns regarding their societal impact as well as applicability of such systems in private and public domains. A quantitative evaluation of demographic …
BenchmarkingFairnessA Deep Dive into Dataset Imbalance and Bias in Face Identification
As the deployment of automated face recognition (FR) systems proliferates, bias in these systems is not just an academic question, but a matter of public concern. Media portrayals often center imbalance as the main sourc…
Face IdentificationFace RecognitionFace VerificationExamining Imbalance Effects on Performance and Demographic Fairness of Clinical Language Models
Data imbalance is a fundamental challenge in applying language models to biomedical applications, particularly in ICD code prediction tasks where label and demographic distributions are uneven. While state-of-the-art lan…
Fairness