On the Cause of Unfairness: A Training Sample Perspective
Identifying the causes of a model's unfairness is an important yet relatively unexplored task. We look into this problem through the lens of training data - the major source of unfairness. We ask the following questions: How would the unfairness of a model change if its training samples (1) were collected from a different (e.g. demographic) group, (2) were labeled differently, or (3) whose features were modified? In other words, we quantify the influence of training samples on unfairness by counterfactually changing samples based on predefined concepts, i.e. data attributes such as features, labels, and sensitive attributes. Our framework not only can help practitioners understand the observed unfairness and mitigate it by repairing their training data, but also leads to many other applications, e.g. detecting mislabeling, fixing imbalanced representations, and detecting fairness-targeted poisoning attacks.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualFairnessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness
In addition to reproducing discriminatory relationships in the training data, machine learning systems can also introduce or amplify discriminatory effects. We refer to this as introduced unfairness, and investigate the …
AttributeUnfairness Discovery and Prevention For Few-Shot Regression
We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for …
FairnessMeta-LearningregressionUnfairness towards subjective opinions in Machine Learning
Despite the high interest for Machine Learning (ML) in academia and industry, many issues related to the application of ML to real-life problems are yet to be addressed. Here we put forward one limitation which arises fr…
BIG-bench Machine LearningTwo Birds with One Stone: Improving Rumor Detection by Addressing the Unfairness Issue
The degraded performance and group unfairness caused by confounding sensitive attributes in rumor detection remains relatively unexplored. To address this, we propose a two-step framework. Initially, it identifies confou…
AttributeFairnessOn the Origins of Bias in NLP through the Lens of the Jim Code
In this paper, we trace the biases in current natural language processing (NLP) models back to their origins in racism, sexism, and homophobia over the last 500 years. We review literature from critical race theory, gend…
Ethics