Explanation-Guided Fairness Testing through Genetic Algorithm
The fairness characteristic is a critical attribute of trusted AI systems. A plethora of research has proposed diverse methods for individual fairness testing. However, they are suffering from three major limitations, i.e., low efficiency, low effectiveness, and model-specificity. This work proposes ExpGA, an explanationguided fairness testing approach through a genetic algorithm (GA). ExpGA employs the explanation results generated by interpretable methods to collect high-quality initial seeds, which are prone to derive discriminatory samples by slightly modifying feature values. ExpGA then adopts GA to search discriminatory sample candidates by optimizing a fitness value. Benefiting from this combination of explanation results and GA, ExpGA is both efficient and effective to detect discriminatory individuals. Moreover, ExpGA only requires prediction probabilities of the tested model, resulting in a better generalization capability to various models. Experiments on multiple real-world benchmarks, including tabular and text datasets, show that ExpGA presents higher efficiency and effectiveness than four state-of-the-art approaches.
Code (1)
Tasks
AttributeFairnessSpecificityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networks
The deep feedforward neural networks (DNNs) are increasingly deployed in socioeconomic critical decision support software systems. DNNs are exceptionally good at finding minimal, sufficient statistical patterns within th…
Decision MakingFairnesssoftware testingFairness of Classifiers in the Presence of Constraints between Features
In Machine Learning, an accepted definition of fairness of a decision taken by a classifier is that it should not depend on protected features, such as gender. Unfortunately, when constraints exist between features, such…
Biased Models Have Biased Explanations
We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we firs…
AttributeBIG-bench Machine LearningFairnessDo Species Evolve Through Mutations Guided by Non-Coding RNAs?
The current theory of evolution is almost the one Darwin and Wallace proposed two centuries ago and the following discoveries e.g., Mendelian genetics and neutral mutation theory have not made significant modifications. …
Search-Based Fairness Testing: An Overview
Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing…
Fairness