paper-with-me

홈 › Papers

NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identification

2021-12-25 · Haibin Zheng, Zhiqing Chen, Tianyu Du, Xuhong Zhang, Yao Cheng, Shouling Ji, Jingyi Wang, Yue Yu, Jinyin Chen

Deep neural networks (DNNs) have demonstrated their outperformance in various domains. However, it raises a social concern whether DNNs can produce reliable and fair decisions especially when they are applied to sensitive domains involving valuable resource allocation, such as education, loan, and employment. It is crucial to conduct fairness testing before DNNs are reliably deployed to such sensitive domains, i.e., generating as many instances as possible to uncover fairness violations. However, the existing testing methods are still limited from three aspects: interpretability, performance, and generalizability. To overcome the challenges, we propose NeuronFair, a new DNN fairness testing framework that differs from previous work in several key aspects: (1) interpretable - it quantitatively interprets DNNs' fairness violations for the biased decision; (2) effective - it uses the interpretation results to guide the generation of more diverse instances in less time; (3) generic - it can handle both structured and unstructured data. Extensive evaluations across 7 datasets and the corresponding DNNs demonstrate NeuronFair's superior performance. For instance, on structured datasets, it generates much more instances (~x5.84) and saves more time (with an average speedup of 534.56%) compared with the state-of-the-art methods. Besides, the instances of NeuronFair can also be leveraged to improve the fairness of the biased DNNs, which helps build more fair and trustworthy deep learning systems.

📄 PDF Abstract BibTeX arXiv:2112.13214

Code (1)

haibinzheng/neuronfair 공식 구현 tf

Tasks

Fairness

Similar Papers 제목 키워드 기반

MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Search

2024-12-28 · Zhaohui Wang, Jingran Yang, Bojie Shao, Min Zhang

Deep neural networks (DNNs) have shown powerful performance in various applications and are increasingly being used in decision-making systems. However, concerns about fairness in DNNs always persist. Some efficient whit…

AttributeDecision MakingFairness

Interpretable Face Manipulation Detection via Feature Whitening

2021-06-21 · Yingying Hua, Daichi Zhang, Pengju Wang, Shiming Ge

Why should we trust the detections of deep neural networks for manipulated faces? Understanding the reasons is important for users in improving the fairness, reliability, privacy and trust of the detection models. In thi…

Fairness

TESTSGD: Interpretable Testing of Neural Networks Against Subtle Group Discrimination

2022-08-24 · Mengdi Zhang, Jun Sun, Jingyi Wang, Bing Sun

Discrimination has been shown in many machine learning applications, which calls for sufficient fairness testing before their deployment in ethic-relevant domains such as face recognition, medical diagnosis and criminal …

Face RecognitionFairnessMedical DiagnosisSentence

Explanation-Guided Fairness Testing through Genetic Algorithm

2022-05-16 · Ming Fan, Wenying Wei, Wuxia Jin, Zijiang Yang 외

The fairness characteristic is a critical attribute of trusted AI systems. A plethora of research has proposed diverse methods for individual fairness testing. However, they are suffering from three major limitations, i.…

AttributeFairnessSpecificity

Testing Group Fairness via Optimal Transport Projections

2021-06-02 · Nian Si, Karthyek Murthy, Jose Blanchet, Viet Anh Nguyen

We present a statistical testing framework to detect if a given machine learning classifier fails to satisfy a wide range of group fairness notions. The proposed test is a flexible, interpretable, and statistically rigor…

Fairness