paper-with-me

Papers

Equilibrium Dynamics and Mitigation of Gender Bias in Synthetically Generated Data

2025-11-12 · Ashish Kattamuri, Arpita Vats, Harshwardhan Fartale, Rahul Raja, Akshata Kishore Moharir, Ishita Prasad arxiv

Recursive prompting with large language models enables scalable synthetic dataset generation but introduces the risk of bias amplification. We investigate gender bias dynamics across three generations of recursive text generation using three complementary evaluation frameworks: rule-based pattern matching, embedding-based semantic similarity, and downstream task performance. Experiments with three initial bias levels (0.1, 0.3, 0.6) and four mitigation strategies reveal equilibrium dynamics rather than monotonic amplification. The low initial bias amplifies toward the model's inherent bias level (+36%), whereas the high initial bias decays toward it (-26%). Among mitigation methods, contrastive augmentation, which introduces gender-swapped variants, achieves significant downstream bias reduction (98.8% for low initial bias and 91% on average) despite producing higher embedding-based bias scores. This paradox demonstrates that semantic similarity metrics may diverge from behavioral fairness outcomes, highlighting the need for multidimensional evaluation in responsible synthetic data generation.

📄 PDF Abstract BibTeX arXiv:2511.10689

Code (0)

등록된 구현이 없습니다.

Tasks

Synthetic Data GenerationSemantic SimilarityText Generation

Similar Papers 제목 키워드 기반

Downstream Fairness Caveats with Synthetic Healthcare Data

2022-03-09 · Karan Bhanot, Ioana Baldini, Dennis Wei, Jiaming Zeng 외

This paper evaluates synthetically generated healthcare data for biases and investigates the effect of fairness mitigation techniques on utility-fairness. Privacy laws limit access to health data such as Electronic Medic…

FairnessGenerative Adversarial Network

CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation

2023-01-01 · Ge Zhang, Yizhi Li, Yaoyao Wu, Linyuan Zhang 외

As natural language processing (NLP) for gender bias becomes a significant interdisciplinary topic, the prevalent data-driven techniques such as large-scale language models suffer from data inadequacy and biased corpus, …

Sentence

How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification

2023-01-30 · Ewoenam Tokpo, Pieter Delobelle, Bettina Berendt, Toon Calders

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstrea…

Fairnesstext-classificationText Classification

Gender Bias Mitigation for Bangla Classification Tasks

2024-11-16 · Sajib Kumar Saha Joy, Arman Hassan Mahy, Meherin Sultana, Azizah Mamun Abha 외

In this study, we investigate gender bias in Bangla pretrained language models, a largely under explored area in low-resource languages. To assess this bias, we applied gender-name swapping techniques to existing dataset…

ClassificationHate Speech DetectionSarcasm DetectionSentiment Analysis

The Birth of Bias: A case study on the evolution of gender bias in an English language model

2022-07-21 · NAACL (GeBNLP) 2022 7 · Oskar van der Wal, Jaap Jumelet, Katrin Schulz, Willem Zuidema

Detecting and mitigating harmful biases in modern language models are widely recognized as crucial, open problems. In this paper, we take a step back and investigate how language models come to be biased in the first pla…

Language ModelingLanguage ModellingSemantic Textual SimilaritySmall Language Model