Are Explainability Tools Gender Biased? A Case Study on Face Presentation Attack Detection
Face recognition (FR) systems continue to spread in our daily lives with an increasing demand for higher explainability and interpretability of FR systems that are mainly based on deep learning. While bias across demographic groups in FR systems has already been studied, the bias of explainability tools has not yet been investigated. As such tools aim at steering further development and enabling a better understanding of computer vision problems, the possible existence of bias in their outcome can lead to a chain of biased decisions. In this paper, we explore the existence of bias in the outcome of explainability tools by investigating the use case of face presentation attack detection. By utilizing two different explainability tools on models with different levels of bias, we investigate the bias in the outcome of such tools. Our study shows that these tools show clear signs of gender bias in the quality of their explanations.
Code (0)
등록된 구현이 없습니다.
Tasks
Face Presentation Attack DetectionFace RecognitionSimilar Papers 제목 키워드 기반
Gender Bias in Explainability: Investigating Performance Disparity in Post-hoc Methods
While research on applications and evaluations of explanation methods continues to expand, fairness of the explanation methods concerning disparities in their performance across subgroups remains an often overlooked aspe…
FairnessAssessing Gender Bias in Machine Translation -- A Case Study with Google Translate
Recently there has been a growing concern about machine bias, where trained statistical models grow to reflect controversial societal asymmetries, such as gender or racial bias. A significant number of AI tools have rece…
Machine TranslationTranslationUser Acceptance of Gender Stereotypes in Automated Career Recommendations
Currently, there is a surge of interest in fair Artificial Intelligence (AI) and Machine Learning (ML) research which aims to mitigate discriminatory bias in AI algorithms, e.g. along lines of gender, age, and race. Whil…
BIG-bench Machine LearningInsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics
This work explores the biases in learning processes based on deep neural network architectures. We analyze how bias affects deep learning processes through a toy example using the MNIST database and a case study in gende…
Bias DetectionContaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing
Gender bias in LLMs has been studied extensively in model outputs, with biased prompts shown to amplify stereotyped generations. Whether such bias propagates into text produced by humans who use these systems, however, r…