De-Biasing Models of Biased Decisions: A Comparison of Methods Using Mortgage Application Data
Prediction models can improve efficiency by automating decisions such as the approval of loan applications. However, they may inherit bias against protected groups from the data they are trained on. This paper adds counterfactual (simulated) ethnic bias to real data on mortgage application decisions, and shows that this bias is replicated by a machine learning model (XGBoost) even when ethnicity is not used as a predictive variable. Next, several other de-biasing methods are compared: averaging over prohibited variables, taking the most favorable prediction over prohibited variables (a novel method), and jointly minimizing errors as well as the association between predictions and prohibited variables. De-biasing can recover some of the original decisions, but the results are sensitive to whether the bias is effected through a proxy.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualSimilar Papers 제목 키워드 기반
How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMs
Recognizing new and rare words - named entities, acronyms, domain specific special words, and other items scarce in training data - remains a key challenge for automatic speech recognition (ASR). We compare two strategie…
Speech RecognitionTake its Essence, Discard its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect
Current methods of toxic language detection (TLD) typically rely on specific tokens to conduct decisions, which makes them suffer from lexical bias, leading to inferior performance and generalization. Lexical bias has bo…
counterfactualCounterfactual InferenceFairnessSentenceFineDeb: A Debiasing Framework for Language Models
As language models are increasingly included in human-facing machine learning tools, bias against demographic subgroups has gained attention. We propose FineDeb, a two-phase debiasing framework for language models that s…
Language ModelingLanguage ModellingSimulate and Optimise: A two-layer mortgage simulator for designing novel mortgage assistance products
We develop a novel two-layer approach for optimising mortgage relief products through a simulated multi-agent mortgage environment. While the approach is generic, here the environment is calibrated to the US mortgage mar…
Towards Automatic Bias Detection in Knowledge Graphs
With the recent surge in social applications relying on knowledge graphs, the need for techniques to ensure fairness in KG based methods is becoming increasingly evident. Previous works have demonstrated that KGs are pro…
Bias DetectionFairnessKnowledge Graph EmbeddingsKnowledge Graphs