paper-with-me

홈 › Papers

Explainability for fair machine learning

2020-10-14 · Tom Begley, Tobias Schwedes, Christopher Frye, Ilya Feige

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is non-trivial: there are many competing definitions, and choosing between them often requires a deep understanding of the underlying task. It is thus tempting to use model explainability to gain insights into model fairness, however existing explainability tools do not reliably indicate whether a model is indeed fair. In this work we present a new approach to explaining fairness in machine learning, based on the Shapley value paradigm. Our fairness explanations attribute a model's overall unfairness to individual input features, even in cases where the model does not operate on sensitive attributes directly. Moreover, motivated by the linearity of Shapley explainability, we propose a meta algorithm for applying existing training-time fairness interventions, wherein one trains a perturbation to the original model, rather than a new model entirely. By explaining the original model, the perturbation, and the fair-corrected model, we gain insight into the accuracy-fairness trade-off that is being made by the intervention. We further show that this meta algorithm enjoys both flexibility and stability benefits with no loss in performance.

📄 PDF Abstract BibTeX arXiv:2010.07389

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeBIG-bench Machine LearningFairness

Similar Papers 제목 키워드 기반

Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models

2022-06-08 · NAACL (TrustNLP) 2022 7 · Esma Balkir, Svetlana Kiritchenko, Isar Nejadgholi, Kathleen C. Fraser

Motivations for methods in explainable artificial intelligence (XAI) often include detecting, quantifying and mitigating bias, and contributing to making machine learning models fairer. However, exactly how an XAI method…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Fairness

The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations

2022-05-06 · Aparna Balagopalan, Haoran Zhang, Kimia Hamidieh, Thomas Hartvigsen 외

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, huma…

BIG-bench Machine LearningFairness

The Effect of Enforcing Fairness on Reshaping Explanations in Machine Learning Models

2025-12-01 · Joshua Wolff Anderson, Shyam Visweswaran arxiv

Trustworthy machine learning in healthcare requires strong predictive performance, fairness, and explanations. While it is known that improving fairness can affect predictive performance, little is known about how fairne…

Feature Importance

Fairness and Explainability: Bridging the Gap Towards Fair Model Explanations

2022-12-07 · Yuying Zhao, Yu Wang, Tyler Derr

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although …

Decision MakingFairness

Constructing Fair Latent Space for Intersection of Fairness and Explainability

2024-12-23 · Hyungjun Joo, Hyeonggeun Han, Sehwan Kim, Sangwoo Hong 외

As the use of machine learning models has increased, numerous studies have aimed to enhance fairness. However, research on the intersection of fairness and explainability remains insufficient, leading to potential issues…

counterfactualFairness