Equilibrium Dynamics and Mitigation of Gender Bias in Synthetically Generated Data
Recursive prompting with large language models enables scalable synthetic dataset generation but introduces the risk of bias amplification. We investigate gender bias dynamics across three generations of recursive text generation using three complementary evaluation frameworks: rule-based pattern matching, embedding-based semantic similarity, and downstream task performance. Experiments with three initial bias levels (0.1, 0.3, 0.6) and four mitigation strategies reveal equilibrium dynamics rather than monotonic amplification. The low initial bias amplifies toward the model's inherent bias level (+36%), whereas the high initial bias decays toward it (-26%). Among mitigation methods, contrastive augmentation, which introduces gender-swapped variants, achieves significant downstream bias reduction (98.8% for low initial bias and 91% on average) despite producing higher embedding-based bias scores. This paradox demonstrates that semantic similarity metrics may diverge from behavioral fairness outcomes, highlighting the need for multidimensional evaluation in responsible synthetic data generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Synthetic Data GenerationSemantic SimilarityText GenerationSimilar Papers 제목 키워드 기반
Downstream Fairness Caveats with Synthetic Healthcare Data
This paper evaluates synthetically generated healthcare data for biases and investigates the effect of fairness mitigation techniques on utility-fairness. Privacy laws limit access to health data such as Electronic Medic…
FairnessGenerative Adversarial NetworkCORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation
As natural language processing (NLP) for gender bias becomes a significant interdisciplinary topic, the prevalent data-driven techniques such as large-scale language models suffer from data inadequacy and biased corpus, …
SentenceHow Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification
To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstrea…
Fairnesstext-classificationText ClassificationGender Bias Mitigation for Bangla Classification Tasks
In this study, we investigate gender bias in Bangla pretrained language models, a largely under explored area in low-resource languages. To assess this bias, we applied gender-name swapping techniques to existing dataset…
ClassificationHate Speech DetectionSarcasm DetectionSentiment AnalysisThe Birth of Bias: A case study on the evolution of gender bias in an English language model
Detecting and mitigating harmful biases in modern language models are widely recognized as crucial, open problems. In this paper, we take a step back and investigate how language models come to be biased in the first pla…
Language ModelingLanguage ModellingSemantic Textual SimilaritySmall Language Model