paper-with-me

홈 › Papers

Intrinsic Meets Extrinsic Fairness: Assessing the Downstream Impact of Bias Mitigation in Large Language Models

2025-09-19 · 'Mina Arzaghi', 'Alireza Dehghanpour Farashah', 'Florian Carichon', ' Golnoosh Farnadi' arxiv

Large Language Models (LLMs) exhibit socio-economic biases that can propagate into downstream tasks. While prior studies have questioned whether intrinsic bias in LLMs affects fairness at the downstream task level, this work empirically investigates the connection. We present a unified evaluation framework to compare intrinsic bias mitigation via concept unlearning with extrinsic bias mitigation via counterfactual data augmentation (CDA). We examine this relationship through real-world financial classification tasks, including salary prediction, employment status, and creditworthiness assessment. Using three open-source LLMs, we evaluate models both as frozen embedding extractors and as fine-tuned classifiers. Our results show that intrinsic bias mitigation through unlearning reduces intrinsic gender bias by up to 94.9%, while also improving downstream task fairness metrics, such as demographic parity by up to 82%, without compromising accuracy. Our framework offers practical guidance on where mitigation efforts can be most effective and highlights the importance of applying early-stage mitigation before downstream deployment.

📄 PDF Abstract BibTeX arXiv:2509.16462

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations

2022-03-25 · ACL 2022 5 · Yang Trista Cao, Yada Pruksachatkun, Kai-Wei Chang, Rahul Gupta 외

Multiple metrics have been introduced to measure fairness in various natural language processing tasks. These metrics can be roughly categorized into two categories: 1) \emph{extrinsic metrics} for evaluating fairness in…

Fairness

How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification

2023-01-30 · Ewoenam Tokpo, Pieter Delobelle, Bettina Berendt, Toon Calders

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstrea…

Fairnesstext-classificationText Classification

Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained Language Models

2022-07-01 · NAACL 2022 7 · Pieter Delobelle, Ewoenam Tokpo, Toon Calders, Bettina Berendt

An increasing awareness of biased patterns in natural language processing resources such as BERT has motivated many metrics to quantify ‘bias’ and ‘fairness’ in these resources. However, comparing the results of differen…

AttributeFairnessSurvey

Characterizing the impact of geometric properties of word embeddings on task performance

2019-04-09 · WS 2019 6 · Brendan Whitaker, Denis Newman-Griffis, Aparajita Haldar, Hakan Ferhatosmanoglu 외

Analysis of word embedding properties to inform their use in downstream NLP tasks has largely been studied by assessing nearest neighbors. However, geometric properties of the continuous feature space contribute directly…

PositionWord Embeddings

A Survey on Fairness in Large Language Models

2023-08-20 · Yingji Li, Mengnan Du, Rui Song, Xin Wang 외

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the b…

FairnessSurvey