paper-with-me

홈 › Papers

Multi-Group Proportional Representation for Text-to-Image Models

2025-05-29 · Sangwon Jung, Alex Oesterling, Claudio Mayrink Verdun, Sajani Vithana, Taesup Moon, Flavio P. Calmon

Text-to-image (T2I) generative models can create vivid, realistic images from textual descriptions. As these models proliferate, they expose new concerns about their ability to represent diverse demographic groups, propagate stereotypes, and efface minority populations. Despite growing attention to the "safe" and "responsible" design of artificial intelligence (AI), there is no established methodology to systematically measure and control representational harms in image generation. This paper introduces a novel framework to measure the representation of intersectional groups in images generated by T2I models by applying the Multi-Group Proportional Representation (MPR) metric. MPR evaluates the worst-case deviation of representation statistics across given population groups in images produced by a generative model, allowing for flexible and context-specific measurements based on user requirements. We also develop an algorithm to optimize T2I models for this metric. Through experiments, we demonstrate that MPR can effectively measure representation statistics across multiple intersectional groups and, when used as a training objective, can guide models toward a more balanced generation across demographic groups while maintaining generation quality.

📄 PDF Abstract BibTeX arXiv:2505.24023

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Multi-Group Proportional Representations for Text-to-Image Models

2025-01-01 · CVPR 2025 1 · Sangwon Jung, Alex Oesterling, Claudio Mayrink Verdun, Sajani Vithana 외

Text-to-image (T2I) generative models can create vivid, realistic images from textual descriptions. As these models proliferate, they expose new concerns about their ability to represent diverse demographic groups, p…

Image Generation

Multi-Group Proportional Representation in Retrieval

2024-07-11 · Alex Oesterling, Claudio Mayrink Verdun, Carol Xuan Long, Alexander Glynn 외

Image search and retrieval tasks can perpetuate harmful stereotypes, erase cultural identities, and amplify social disparities. Current approaches to mitigate these representational harms balance the number of retrieved …

Image RetrievalRetrieval

Full Proportional Justified Representation

2025-01-21 · Yusuf Hakan Kalayci, Jiasen Liu, David Kempe

In multiwinner approval voting, forming a committee that proportionally represents voters' approval ballots is an essential task. The notion of justified representation (JR) demands that any large "cohesive" group of vot…

Fair admission risk prediction with proportional multicalibration

2022-09-29 · William La Cava, Elle Lett, Guangya Wan

Fair calibration is a widely desirable fairness criteria in risk prediction contexts. One way to measure and achieve fair calibration is with multicalibration. Multicalibration constrains calibration error among flexibly…

FairnessPrediction

Temporal Panel Selection in Ongoing Citizens' Assemblies

2026-02-18 · Yusuf Hakan Kalayci, Evi Micha arxiv

Permanent citizens' assemblies are ongoing deliberative bodies composed of randomly selected citizens, organized into panels that rotate over time. Unlike one-off panels, which represent the population in a single snapsh…