paper-with-me

Papers

Enhanced Fairness Testing via Generating Effective Initial Individual Discriminatory Instances

2022-09-17 · Minghua Ma, Zhao Tian, Max Hort, Federica Sarro, Hongyu Zhang, QIngwei Lin, Dongmei Zhang

Fairness testing aims at mitigating unintended discrimination in the decision-making process of data-driven AI systems. Individual discrimination may occur when an AI model makes different decisions for two distinct individuals who are distinguishable solely according to protected attributes, such as age and race. Such instances reveal biased AI behaviour, and are called Individual Discriminatory Instances (IDIs). In this paper, we propose an approach for the selection of the initial seeds to generate IDIs for fairness testing. Previous studies mainly used random initial seeds to this end. However this phase is crucial, as these seeds are the basis of the follow-up IDIs generation. We dubbed our proposed seed selection approach I&D. It generates a large number of initial IDIs exhibiting a great diversity, aiming at improving the overall performance of fairness testing. Our empirical study reveal that I&D is able to produce a larger number of IDIs with respect to four state-of-the-art seed generation approaches, generating 1.68X more IDIs on average. Moreover, we compare the use of I&D to train machine learning models and find that using I&D reduces the number of remaining IDIs by 29% when compared to the state-of-the-art, thus indicating that I&D is effective for improving model fairness

📄 PDF Abstract BibTeX arXiv:2209.08321

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDiversityFairness

Similar Papers 제목 키워드 기반

Metamorphic Testing for Fairness Evaluation in Large Language Models: Identifying Intersectional Bias in LLaMA and GPT

2025-04-04 · Harishwar Reddy, Madhusudan Srinivasan, Upulee Kanewala

Large Language Models (LLMs) have made significant strides in Natural Language Processing but remain vulnerable to fairness-related issues, often reflecting biases inherent in their training data. These biases pose risks…

Fairness

Concolic Testing on Individual Fairness of Neural Network Models

2025-09-08 · Ming-I Huang, Chih-Duo Hong, Fang Yu arxiv

This paper introduces PyFair, a formal framework for evaluating and verifying individual fairness of Deep Neural Networks (DNNs). By adapting the concolic testing tool PyCT, we generate fairness-specific path constraints…

fAux: Testing Individual Fairness via Gradient Alignment

2022-10-10 · Giuseppe Castiglione, Ga Wu, Christopher Srinivasa, Simon Prince

Machine learning models are vulnerable to biases that result in unfair treatment of individuals from different populations. Recent work that aims to test a model's fairness at the individual level either relies on domain…

Fairness

Explanation-Guided Fairness Testing through Genetic Algorithm

2022-05-16 · Ming Fan, Wenying Wei, Wuxia Jin, Zijiang Yang 외

The fairness characteristic is a critical attribute of trusted AI systems. A plethora of research has proposed diverse methods for individual fairness testing. However, they are suffering from three major limitations, i.…

AttributeFairnessSpecificity

BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models

2025-04-30 · Zhiting Fan, Ruizhe Chen, Zuozhu Liu

Identifying bias in LLM-generated content is a crucial prerequisite for ensuring fairness in LLMs. Existing methods, such as fairness classifiers and LLM-based judges, face limitations related to difficulties in understa…

Bias DetectionDecision MakingFairness