Reranking individuals: The effect of fair classification within-groups
Artificial Intelligence (AI) finds widespread application across various domains, but it sparks concerns about fairness in its deployment. The prevailing discourse in classification often emphasizes outcome-based metrics comparing sensitive subgroups without a nuanced consideration of the differential impacts within subgroups. Bias mitigation techniques not only affect the ranking of pairs of instances across sensitive groups, but often also significantly affect the ranking of instances within these groups. Such changes are hard to explain and raise concerns regarding the validity of the intervention. Unfortunately, these effects remain under the radar in the accuracy-fairness evaluation framework that is usually applied. Additionally, we illustrate the effect of several popular bias mitigation methods, and how their output often does not reflect real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessRerankingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fairness Through Computationally-Bounded Awareness
We study the problem of fair classification within the versatile framework of Dwork et al. [ITCS '12], which assumes the existence of a metric that measures similarity between pairs of individuals. Unlike earlier work, w…
FairnessAverage Individual Fairness: Algorithms, Generalization and Experiments
We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individua…
ClassificationFairnessGeneral ClassificationA Canonical Data Transformation for Achieving Inter- and Within-group Fairness
Increases in the deployment of machine learning algorithms for applications that deal with sensitive data have brought attention to the issue of fairness in machine learning. Many works have been devoted to applications …
FairnessLLM4Rerank: LLM-based Auto-Reranking Framework for Recommendations
Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern app…
DiversityFairnessRecommendation SystemsRerankingFinA: Fairness of Adverse Effects in Decision-Making of Human-Cyber-Physical-System
Ensuring fairness in decision-making systems within Human-Cyber-Physical-Systems (HCPS) is a pressing concern, particularly when diverse individuals, each with varying behaviors and expectations, coexist within the same …
Decision MakingFairness