paper-with-me

Papers

Bias in Generative AI

2024-03-05 · Mi Zhou, Vibhanshu Abhishek, Timothy Derdenger, Jaymo Kim, Kannan Srinivasan

This study analyzed images generated by three popular generative artificial intelligence (AI) tools - Midjourney, Stable Diffusion, and DALLE 2 - representing various occupations to investigate potential bias in AI generators. Our analysis revealed two overarching areas of concern in these AI generators, including (1) systematic gender and racial biases, and (2) subtle biases in facial expressions and appearances. Firstly, we found that all three AI generators exhibited bias against women and African Americans. Moreover, we found that the evident gender and racial biases uncovered in our analysis were even more pronounced than the status quo when compared to labor force statistics or Google images, intensifying the harmful biases we are actively striving to rectify in our society. Secondly, our study uncovered more nuanced prejudices in the portrayal of emotions and appearances. For example, women were depicted as younger with more smiles and happiness, while men were depicted as older with more neutral expressions and anger, posing a risk that generative AI models may unintentionally depict women as more submissive and less competent than men. Such nuanced biases, by their less overt nature, might be more problematic as they can permeate perceptions unconsciously and may be more difficult to rectify. Although the extent of bias varied depending on the model, the direction of bias remained consistent in both commercial and open-source AI generators. As these tools become commonplace, our study highlights the urgency to identify and mitigate various biases in generative AI, reinforcing the commitment to ensuring that AI technologies benefit all of humanity for a more inclusive future.

📄 PDF Abstract BibTeX arXiv:2403.02726

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Geographic Bias and Diversity in AI Evaluation

2026-04-28 · Zilong Liu, Krzysztof Janowicz, Gengchen Mai, Song Gao 외 arxiv

Among the many challenges hindering the responsible development and deployment of AI, arguably none has faced more intense scrutiny than bias in its various forms. This underscores the widespread concerns across AI resea…

A Generative Approach for Mitigating Structural Biases in Natural Language Inference

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to cla…

Natural Language Inference

A Generative Approach for Mitigating Structural Biases in Natural Language Inference

2021-08-31 · *SEM (NAACL) 2022 7 · Dimion Asael, Zachary Ziegler, Yonatan Belinkov

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to mak…

Natural Language Inference

OpenBias: Open-set Bias Detection in Text-to-Image Generative Models

2024-04-11 · CVPR 2024 1 · Moreno D'Incà, Elia Peruzzo, Massimiliano Mancini, Dejia Xu 외

Text-to-image generative models are becoming increasingly popular and accessible to the general public. As these models see large-scale deployments, it is necessary to deeply investigate their safety and fairness to not …

Bias DetectionFairnessLanguage ModelingLanguage Modelling+2

Biases in Generative Art -- A Causal Look from the Lens of Art History

2020-10-26 · Ramya Srinivasan, Kanji Uchino

With rapid progress in artificial intelligence (AI), popularity of generative art has grown substantially. From creating paintings to generating novel art styles, AI based generative art has showcased a variety of applic…

Style Transfer