paper-with-me

Papers

Making ML models fairer through explanations: the case of LimeOut

2020-11-01 · Guilherme Alves, Vaishnavi Bhargava, Miguel Couceiro, Amedeo Napoli

Algorithmic decisions are now being used on a daily basis, and based on Machine Learning (ML) processes that may be complex and biased. This raises several concerns given the critical impact that biased decisions may have on individuals or on society as a whole. Not only unfair outcomes affect human rights, they also undermine public trust in ML and AI. In this paper we address fairness issues of ML models based on decision outcomes, and we show how the simple idea of "feature dropout" followed by an "ensemble approach" can improve model fairness. To illustrate, we will revisit the case of "LimeOut" that was proposed to tackle "process fairness", which measures a model's reliance on sensitive or discriminatory features. Given a classifier, a dataset and a set of sensitive features, LimeOut first assesses whether the classifier is fair by checking its reliance on sensitive features using "Lime explanations". If deemed unfair, LimeOut then applies feature dropout to obtain a pool of classifiers. These are then combined into an ensemble classifier that was empirically shown to be less dependent on sensitive features without compromising the classifier's accuracy. We present different experiments on multiple datasets and several state of the art classifiers, which show that LimeOut's classifiers improve (or at least maintain) not only process fairness but also other fairness metrics such as individual and group fairness, equal opportunity, and demographic parity.

📄 PDF Abstract BibTeX arXiv:2011.00603

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

LimeOut: An Ensemble Approach To Improve Process Fairness

2020-06-17 · Vaishnavi Bhargava, Miguel Couceiro, Amedeo Napoli

Artificial Intelligence and Machine Learning are becoming increasingly present in several aspects of human life, especially, those dealing with decision making. Many of these algorithmic decisions are taken without human…

Decision MakingFairness

The Impact of Explanations on Fairness in Human-AI Decision-Making: Protected vs Proxy Features

2023-10-12 · Navita Goyal, Connor Baumler, Tin Nguyen, Hal Daumé III

AI systems have been known to amplify biases in real-world data. Explanations may help human-AI teams address these biases for fairer decision-making. Typically, explanations focus on salient input features. If a model i…

Decision MakingFairness

Perceptions of Fairness and Trustworthiness Based on Explanations in Human vs. Automated Decision-Making

2021-09-13 · Jakob Schoeffer, Yvette Machowski, Niklas Kuehl

Automated decision systems (ADS) have become ubiquitous in many high-stakes domains. Those systems typically involve sophisticated yet opaque artificial intelligence (AI) techniques that seldom allow for full comprehensi…

Decision MakingFairness

Counterfactual Explanation for Fairness in Recommendation

2023-07-10 · Xiangmeng Wang, Qian Li, Dianer Yu, Qing Li 외

Fairness-aware recommendation eliminates discrimination issues to build trustworthy recommendation systems.Explaining the causes of unfair recommendations is critical, as it promotes fairness diagnostics, and thus secure…

AttributeCausal InferencecounterfactualCounterfactual Explanation+2

Fairer Software Made Easier (using "Keys")

2021-07-11 · Tim Menzies, Kewen Peng, Andre Lustosa

Can we simplify explanations for software analytics? Maybe. Recent results show that systems often exhibit a "keys effect"; i.e. a few key features control the rest. Just to say the obvious, for systems controlled by a f…