Measuring Fairness in Generative Models
Deep generative models have made much progress in improving training stability and quality of generated data. Recently there has been increased interest in the fairness of deep-generated data. Fairness is important in many applications, e.g. law enforcement, as biases will affect efficacy. Central to fair data generation are the fairness metrics for the assessment and evaluation of different generative models. In this paper, we first review fairness metrics proposed in previous works and highlight potential weaknesses. We then discuss a performance benchmark framework along with the assessment of alternative metrics.
Code (1)
Tasks
FairnessSimilar Papers 제목 키워드 기반
On Measuring Fairness in Generative Models
Recently, there has been increased interest in fair generative models. In this work, we conduct, for the first time, an in-depth study on fairness measurement, a critical component in gauging progress on fair generative …
AttributeFairnessComparing Fairness of Generative Mobility Models
This work examines the fairness of generative mobility models, addressing the often overlooked dimension of equity in model performance across geographic regions. Predictive models built on crowd flow data are instrument…
FairnessFrom Efficiency to Equity: Measuring Fairness in Preference Learning
As AI systems, particularly generative models, increasingly influence decision-making, ensuring that they are able to fairly represent diverse human preferences becomes crucial. This paper introduces a novel framework fo…
Decision MakingEthicsFairnessPC-Fairness: A Unified Framework for Measuring Causality-based Fairness
A recent trend of fair machine learning is to define fairness as causality-based notions which concern the causal connection between protected attributes and decisions. However, one common challenge of all causality-base…
counterfactualFairnessWho Defines Fairness? Target-Based Prompting for Demographic Representation in Generative Models
Text-to-image(T2I) models like Stable Diffusion and DALL-E have made generative AI widely accessible, yet recent studies reveal that these systems often replicate societal biases, particularly in how they depict demograp…