paper-with-me

홈 › Papers

InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics

2020-04-14 · Ignacio Serna, Alejandro Peña, Aythami Morales, Julian Fierrez

This work explores the biases in learning processes based on deep neural network architectures. We analyze how bias affects deep learning processes through a toy example using the MNIST database and a case study in gender detection from face images. We employ two gender detection models based on popular deep neural networks. We present a comprehensive analysis of bias effects when using an unbalanced training dataset on the features learned by the models. We show how bias impacts in the activations of gender detection models based on face images. We finally propose InsideBias, a novel method to detect biased models. InsideBias is based on how the models represent the information instead of how they perform, which is the normal practice in other existing methods for bias detection. Our strategy with InsideBias allows to detect biased models with very few samples (only 15 images in our case study). Our experiments include 72K face images from 24K identities and 3 ethnic groups.

📄 PDF Abstract BibTeX arXiv:2004.06592

Code (0)

등록된 구현이 없습니다.

Tasks

Bias Detection

Similar Papers 제목 키워드 기반

Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision

2026-07-08 · Ignacio Serna, Aythami Morales, Julian Fierrez arxiv

This study investigates the presence and propagation of bias within Neural Networks through a comprehensive multi-level analysis spanning the learned latent space, layer activations, and the network's parameters. Based o…

Bias Detection

Second Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference Resolution

2021-09-28 · ACL (GeBNLP) 2021 8 · Hillary Dawkins

We observe an instance of gender-induced bias in a downstream application, despite the absence of explicit gender words in the test cases. We provide a test set, SoWinoBias, for the purpose of measuring such latent gende…

Bias Detectioncoreference-resolutionCoreference ResolutionGender Bias Detection

Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark Datasets

2025-01-02 · Mahdi Zakizadeh, Mohammad Taher Pilehvar

The multifaceted challenge of accurately measuring gender stereotypical bias in language models is akin to discerning different segments of a broader, unseen entity. This short paper primarily focuses on intrinsic bias m…

Towards causal benchmarking of bias in face analysis algorithms

2020-07-13 · ECCV 2020 8 · Guha Balakrishnan, Yuanjun Xiong, Wei Xia, Pietro Perona

Measuring algorithmic bias is crucial both to assess algorithmic fairness, and to guide the improvement of algorithms. Current methods to measure algorithmic bias in computer vision, which are based on observational data…

AttributeBenchmarkingFairnessGender Classification

Biased Embeddings from Wild Data: Measuring, Understanding and Removing

2018-06-16 · Adam Sutton, Thomas Lansdall-Welfare, Nello Cristianini

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" …