Fairness in machine learning: against false positive rate equality as a measure of fairness
As machine learning informs increasingly consequential decisions, different metrics have been proposed for measuring algorithmic bias or unfairness. Two popular fairness measures are calibration and equality of false positive rate. Each measure seems intuitively important, but notably, it is usually impossible to satisfy both measures. For this reason, a large literature in machine learning speaks of a fairness tradeoff between these two measures. This framing assumes that both measures are, in fact, capturing something important. To date, philosophers have not examined this crucial assumption, and examined to what extent each measure actually tracks a normatively important property. This makes this inevitable statistical conflict, between calibration and false positive rate equality, an important topic for ethics. In this paper, I give an ethical framework for thinking about these measures and argue that, contrary to initial appearances, false positive rate equality does not track anything about fairness, and thus sets an incoherent standard for evaluating the fairness of algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningEthicsFairnessSimilar Papers 제목 키워드 기반
Machine Learning Fairness in Justice Systems: Base Rates, False Positives, and False Negatives
Machine learning best practice statements have proliferated, but there is a lack of consensus on what the standards should be. For fairness standards in particular, there is little guidance on how fairness might be achie…
BIG-bench Machine LearningFairnessIs calibration a fairness requirement? An argument from the point of view of moral philosophy and decision theory
In this paper, we provide a moral analysis of two criteria of statistical fairness debated in the machine learning literature: 1) calibration between groups and 2) equality of false positive and false negative rates betw…
FairnessPhilosophyFairGSE: Fairness-Aware Graph Neural Network without High False Positive Rates
Graph neural networks (GNNs) have emerged as the mainstream paradigm for graph representation learning due to their effective message aggregation. However, this advantage also amplifies biases inherent in graph topology,…
Graph Representation LearningGraph Neural NetworkFairness-aware Model-agnostic Positive and Unlabeled Learning
With the increasing application of machine learning in high-stake decision-making problems, potential algorithmic bias towards people from certain social groups poses negative impacts on individuals and our society at la…
Binary ClassificationDecision MakingFairnessMedical Diagnosis+1Auditing ICU Readmission Rates in an Clinical Database: An Analysis of Risk Factors and Clinical Outcomes
This study presents a machine learning (ML) pipeline for clinical data classification in the context of a 30-day readmission problem, along with a fairness audit on subgroups based on sensitive attributes. A range of ML …
Fairness