Fairness Violations and Mitigation under Covariate Shift
We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Stability against changes in data distribution is an important mandate for responsible deployment of models. The domain adaptation literature addresses this concern, albeit with the notion of stability limited to that of prediction accuracy. We identify sufficient conditions under which stable models, both in terms of prediction accuracy and fairness, can be learned. Using the causal graph describing the data and the anticipated shifts, we specify an approach based on feature selection that exploits conditional independencies in the data to estimate accuracy and fairness metrics for the test set. We show that for specific fairness definitions, the resulting model satisfies a form of worst-case optimality. In context of a healthcare task, we illustrate the advantages of the approach in making more equitable decisions.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationFairnessfeature selectionPredictionSelection biasMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fairness Transferability Subject to Bounded Distribution Shift
Given an algorithmic predictor that is "fair" on some source distribution, will it still be fair on an unknown target distribution that differs from the source within some bound? In this paper, we study the transferabili…
BIG-bench Machine LearningFairnessFairness under Covariate Shift: Improving Fairness-Accuracy tradeoff with few Unlabeled Test Samples
Covariate shift in the test data is a common practical phenomena that can significantly downgrade both the accuracy and the fairness performance of the model. Ensuring fairness across different sensitive groups under cov…
FairnessOut-of-Distribution GeneralizationLearning Fair Invariant Representations under Covariate and Correlation Shifts Simultaneously
Achieving the generalization of an invariant classifier from training domains to shifted test domains while simultaneously considering model fairness is a substantial and complex challenge in machine learning. Existing m…
Domain GeneralizationFairnessTesting for concept shift online
This note continues study of exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the observations. Such processes can be used for detecting violations of the IID assu…
Conformal PredictionAlgorithmic Fairness Generalization under Covariate and Dependence Shifts Simultaneously
The endeavor to preserve the generalization of a fair and invariant classifier across domains, especially in the presence of distribution shifts, becomes a significant and intricate challenge in machine learning. In resp…
Domain GeneralizationFairnessNavigate