paper-with-me

홈 › Papers

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

2023-02-16 · Zichong Wang, Yang Zhou, Israat Haque, David Lo, Wenbin Zhang

The increasing use of Machine Learning (ML) software can lead to unfair and unethical decisions, thus fairness bugs in software are becoming a growing concern. Addressing these fairness bugs often involves sacrificing ML performance, such as accuracy. To address this issue, we present a novel counterfactual approach that uses counterfactual thinking to tackle the root causes of bias in ML software. In addition, our approach combines models optimized for both performance and fairness, resulting in an optimal solution in both aspects. We conducted a thorough evaluation of our approach on 10 benchmark tasks using a combination of 5 performance metrics, 3 fairness metrics, and 15 measurement scenarios, all applied to 8 real-world datasets. The conducted extensive evaluations show that the proposed method significantly improves the fairness of ML software while maintaining competitive performance, outperforming state-of-the-art solutions in 84.6% of overall cases based on a recent benchmarking tool.

📄 PDF Abstract BibTeX arXiv:2302.08018

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingcounterfactualFairness

Similar Papers 제목 키워드 기반

From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits?

2024-12-18 · Gianmario Voria, Stefano Lambiase, Maria Concetta Schiavone, Gemma Catolino 외

As the adoption of machine learning (ML) systems continues to grow across industries, concerns about fairness and bias in these systems have taken center stage. Fairness toolkits, designed to mitigate bias in ML models, …

Fairness

FairLoop: Software Support for Human-Centric Fairness in Predictive Business Process Monitoring

2025-08-27 · Felix Möhrlein, Martin Käppel, Julian Neuberger, Sven Weinzierl 외 arxiv

Sensitive attributes like gender or age can lead to unfair predictions in machine learning tasks such as predictive business process monitoring, particularly when used without considering context. We present FairLoop1, a…

A Catalog of Fairness-Aware Practices in Machine Learning Engineering

2024-08-29 · Gianmario Voria, Giulia Sellitto, Carmine Ferrara, Francesco Abate 외

Machine learning's widespread adoption in decision-making processes raises concerns about fairness, particularly regarding the treatment of sensitive features and potential discrimination against minorities. The software…

Decision MakingFairness

Fairness-aware Configuration of Machine Learning Libraries

2022-02-13 · Saeid Tizpaz-Niari, Ashish Kumar, Gang Tan, Ashutosh Trivedi

This paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs. Data-driven software is increasingly applied in social-critical applications where ensuring fair…

BIG-bench Machine LearningFairnesssoftware testing

Astraea: Grammar-based Fairness Testing

2020-10-06 · Ezekiel Soremekun, Sakshi Udeshi, Sudipta Chattopadhyay

Software often produces biased outputs. In particular, machine learning (ML) based software are known to produce erroneous predictions when processing discriminatory inputs. Such unfair program behavior can be caused by …

FairnessFault Diagnosis