paper-with-me

Papers

Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness

2023-02-07 · Felix Friedrich, Manuel Brack, Lukas Struppek, Dominik Hintersdorf, Patrick Schramowski, Sasha Luccioni, Kristian Kersting

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly scraped from the internet, they also suffer from degenerated and biased human behavior, as we demonstrate. In fact, they may even reinforce such biases. To not only uncover but also combat these undesired effects, we present a novel strategy, called Fair Diffusion, to attenuate biases after the deployment of generative text-to-image models. Specifically, we demonstrate shifting a bias, based on human instructions, in any direction yielding arbitrarily new proportions for, e.g., identity groups. As our empirical evaluation demonstrates, this introduced control enables instructing generative image models on fairness, with no data filtering and additional training required.

📄 PDF Abstract BibTeX arXiv:2302.10893

Code (1)

ml-research/fair-diffusion 공식 구현 pytorch

Tasks

FairnessImage GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Fair Text-to-Image Diffusion via Fair Mapping

2023-11-29 · Jia Li, Lijie Hu, Jingfeng Zhang, Tianhang Zheng 외

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target…

FairnessImage GenerationText-to-Image Generation

SEGA: Instructing Text-to-Image Models using Semantic Guidance

2023-01-28 · NeurIPS 2023 11 · Manuel Brack, Felix Friedrich, Dominik Hintersdorf, Lukas Struppek 외

Text-to-image diffusion models have recently received a lot of interest for their astonishing ability to produce high-fidelity images from text only. However, achieving one-shot generation that aligns with the user's int…

Instructing Text-to-Image Diffusion Models via Classifier-Guided Semantic Optimization

2025-05-20 · Yuanyuan Chang, Yinghua Yao, Tao Qin, Mengmeng Wang 외

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by th…

AttributeDisentanglementImage Generation

FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbation

2024-12-29 · Yan Luo, Muhammad Osama Khan, Congcong Wen, Muhammad Muneeb Afzal 외

Recent progress in generative AI, especially diffusion models, has demonstrated significant utility in text-to-image synthesis. Particularly in healthcare, these models offer immense potential in generating synthetic dat…

FairnessImage Generation

FairHuman: Boosting Hand and Face Quality in Human Image Generation with Minimum Potential Delay Fairness in Diffusion Models

2025-07-03 · Yuxuan Wang, Tianwei Cao, Huayu Zhang, Zhongjiang He 외 arxiv

Image generation has achieved remarkable progress with the development of large-scale text-to-image models, especially diffusion-based models. However, generating human images with plausible details, such as faces or han…

Image Generation