Debiasing Pretrained Generative Models by Uniformly Sampling Semantic Attributes
Generative models are being increasingly used in science and industry applications. Unfortunately, they often perpetuate the biases present in their training sets, such as societal biases causing certain groups to be underrepresented in the data. For instance, image generators may overwhelmingly produce images of white people due to few non-white samples in their training data. It is imperative to debias generative models so they synthesize an equal number of instances for each group, while not requiring retraining of the model to avoid prohibitive expense. We thus propose a *distribution mapping module* that produces samples from a *fair noise distribution*, such that the pretrained generative model produces *semantically uniform* outputs - an equal number of instances for each group - when conditioned on these samples. This does *not* involve retraining the generator, nor does it require *any* real training data. Experiments on debiasing generators trained on popular real-world datasets show that our method outperforms existing approaches.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders
Pretrained text encoders, such as BERT, have been applied increasingly in various natural language processing (NLP) tasks, and have recently demonstrated significant performance gains. However, recent studies have demons…
Contrastive LearningFairnessSentenceMAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Pretrained Language Models (PLMs) are widely used in NLP for various tasks. Recent studies have identified various biases that such models exhibit and have proposed methods to correct these biases. However, most of the w…
counterfactualData AugmentationLanguage ModelingLanguage ModellingDiagnosing and Debiasing Corpus-Based Political Bias and Insults in GPT2
The training of large language models (LLMs) on extensive, unfiltered corpora sourced from the internet is a common and advantageous practice. Consequently, LLMs have learned and inadvertently reproduced various types of…
SegDebias: Test-Time Bias Mitigation for ViT-Based CLIP via Segmentation
Vision language models such as CLIP have shown remarkable performance in zero shot classification, but remain susceptible to spurious correlations, where irrelevant visual features influence predictions. Existing debiasi…
Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling
Pretrained language models (PLMs), such as GPT2, have achieved remarkable empirical performance in text generation tasks. However, pretrained on large-scale natural language corpora, the generated text from PLMs may exhi…
FairnessLanguage ModelingLanguage ModellingSentence+1