Assessing Demographic Bias Transfer from Dataset to Model: A Case Study in Facial Expression Recognition

2022-05-20 · Iris Dominguez-Catena, Daniel Paternain, Mikel Galar

The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class multi-demographic classification problems, such as Facial Expression Recognition (FER). We propose a new set of metrics to approach these problems. Of the three metrics proposed, two focus on the representational and stereotypical bias of the dataset, and the third one on the residual bias of the trained model. These metrics combined can potentially be used to study and compare diverse bias mitigation methods. We demonstrate the usefulness of the metrics by applying them to a FER problem based on the popular Affectnet dataset. Like many other datasets for FER, Affectnet is a large Internet-sourced dataset with 291,651 labeled images. Obtaining images from the Internet raises some concerns over the fairness of any system trained on this data and its ability to generalize properly to diverse populations. We first analyze the dataset and some variants, finding substantial racial bias and gender stereotypes. We then extract several subsets with different demographic properties and train a model on each one, observing the amount of residual bias in the different setups. We also provide a second analysis on a different dataset, FER+.

📄 PDF Abstract BibTeX arXiv:2205.10049

Code (1)

irisdominguez/dataset-bias-metrics 공식 구현 pytorch

Tasks

Facial Expression Recognition Facial Expression Recognition (FER)Fairness

Assessing Demographic Bias in Named Entity Recognition

2020-08-08 · Shubhanshu Mishra, Sijun He, Luca Belli

Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)NER

Bias in the Ear of the Listener: Assessing Sensitivity in Audio Language Models Across Linguistic, Demographic, and Positional Variations

2026-02-01 · Sheng-Lun Wei, Yu-Ling Liao, Yen-Hua Chang, Hen-Hsen Huang 외 arxiv

This work presents the first systematic investigation of speech bias in multilingual MLLMs. We construct and release the BiasInEar dataset, a speech-augmented benchmark based on Global MMLU Lite, spanning English, Chines…

DiversityMedQA: Assessing Demographic Biases in Medical Diagnosis using Large Language Models

2024-09-02 · Rajat Rawat, Hudson McBride, Dhiyaan Nirmal, Rajarshi Ghosh 외

As large language models (LLMs) gain traction in healthcare, concerns about their susceptibility to demographic biases are growing. We introduce {DiversityMedQA}, a novel benchmark designed to assess LLM responses to med…

Medical Diagnosis MedQA

Assessing Bias in Metric Models for LLM Open-Ended Generation Bias Benchmarks

2024-10-14 · Nathaniel Demchak, Xin Guan, Zekun Wu, Ziyi Xu 외

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This…

Transferring Fairness using Multi-Task Learning with Limited Demographic Information

2023-05-22 · Carlos Aguirre, Mark Dredze

Training supervised machine learning systems with a fairness loss can improve prediction fairness across different demographic groups. However, doing so requires demographic annotations for training data, without which w…

Fairness Multi-Task Learning Transfer Learning