paper-with-me

홈 › Papers

Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performance

2021-03-10 · Joshua R. Minot, Nicholas Cheney, Marc Maier, Danne C. Elbers, Christopher M. Danforth, Peter Sheridan Dodds

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing interest in building algorithmic fairness into processes impacting patient care. Much of the work addressing this question has focused on biases encoded in language models -- statistical estimates of the relationships between concepts derived from distant reading of corpora. Building on this work, we investigate how word choices made by healthcare practitioners and language models interact with regards to bias. We identify and remove gendered language from two clinical-note datasets and describe a new debiasing procedure using BERT-based gender classifiers. We show minimal degradation in health condition classification tasks for low- to medium-levels of bias removal via data augmentation. Finally, we compare the bias semantically encoded in the language models with the bias empirically observed in health records. This work outlines an interpretable approach for using data augmentation to identify and reduce the potential for bias in natural language processing pipelines.

📄 PDF Abstract BibTeX arXiv:2103.05841

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationFairness

Similar Papers 제목 키워드 기반

Fairness-Aware Interpretable Modeling (FAIM) for Trustworthy Machine Learning in Healthcare

2024-03-08 · Mingxuan Liu, Yilin Ning, Yuhe Ke, Yuqing Shang 외

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAI…

Fairness

CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation

2023-01-01 · Ge Zhang, Yizhi Li, Yaoyao Wu, Linyuan Zhang 외

As natural language processing (NLP) for gender bias becomes a significant interdisciplinary topic, the prevalent data-driven techniques such as large-scale language models suffer from data inadequacy and biased corpus, …

Sentence

On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning

2020-10-24 · NAACL 2021 4 · Xisen Jin, Francesco Barbieri, Brendan Kennedy, Aida Mostafazadeh Davani 외

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, re…

coreference-resolutionCoreference ResolutionFairnessHate Speech Detection+6

How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification

2023-01-30 · Ewoenam Tokpo, Pieter Delobelle, Bettina Berendt, Toon Calders

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstrea…

Fairnesstext-classificationText Classification

Robustly Improving LLM Fairness in Realistic Settings via Interpretability

2025-06-12 · Adam Karvonen, Samuel Marks

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can …

AttributeFairness