paper-with-me

Papers

Imagining an Engineer: On GAN-Based Data Augmentation Perpetuating Biases

2018-11-09 · Niharika Jain, Lydia Manikonda, Alberto Olmo Hernandez, Sailik Sengupta, Subbarao Kambhampati

The use of synthetic data generated by Generative Adversarial Networks (GANs) has become quite a popular method to do data augmentation for many applications. While practitioners celebrate this as an economical way to get more synthetic data that can be used to train downstream classifiers, it is not clear that they recognize the inherent pitfalls of this technique. In this paper, we aim to exhort practitioners against deriving any false sense of security against data biases based on data augmentation. To drive this point home, we show that starting with a dataset consisting of head-shots of engineering researchers, GAN-based augmentation "imagines" synthetic engineers, most of whom have masculine features and white skin color (inferred from a human subject study conducted on Amazon Mechanical Turk). This demonstrates how biases inherent in the training data are reinforced, and sometimes even amplified, by GAN-based data augmentation; it should serve as a cautionary tale for the lay practitioners.

📄 PDF Abstract BibTeX arXiv:1811.03751

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Fairness in Machine Learning meets with Equity in Healthcare

2023-05-11 · Shaina Raza, Parisa Osivand Pour, Syed Raza Bashir

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can ha…

Fairness

Assessing Intersectional Bias in Representations of Pre-Trained Image Recognition Models

2025-06-04 · Valerie Krug, Sebastian Stober

Deep Learning models have achieved remarkable success. Training them is often accelerated by building on top of pre-trained models which poses the risk of perpetuating encoded biases. Here, we investigate biases in the r…

Is General-Purpose AI Reasoning Sensitive to Data-Induced Cognitive Biases? Dynamic Benchmarking on Typical Software Engineering Dilemmas

2025-08-15 · Francesco Sovrano, Gabriele Dominici, Rita Sevastjanova, Alessandra Stramiglio 외 arxiv

Human cognitive biases in software engineering can lead to costly errors. While general-purpose AI (GPAI) systems may help mitigate these biases due to their non-human nature, their training on human-generated data raise…

Inpaint Biases: A Pathway to Accurate and Unbiased Image Generation

2024-05-29 · Jiyoon Myung, Jihyeon Park

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations …

Image Generation

Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMs

2024-10-31 · Muhammed Saeed, Elgizouli Mohamed, Mukhtar Mohamed, Shaina Raza 외

Large language models (LLMs) are widely used but raise ethical concerns due to embedded social biases. This study examines LLM biases against Arabs versus Westerners across eight domains, including women's rights, terror…

Red Teaming