paper-with-me

Papers

Learning an Ethical Module for Bias Mitigation of pre-trained Models

2021-09-29 · Jean-Rémy Conti, Nathan Noiry, Stephan Clemencon, Vincent Despiegel, Stéphane Gentric

In spite of the high performance and reliability of deep learning algorithms in broad range everyday applications, many investigations tend to show that a lot of models exhibit biases, discriminating against some subgroups of the population. This urges the practitioner to develop fair systems whose performances are uniform among individuals. In this work, we propose a post-processing method designed to mitigate bias of state-of-the-art models. It consists in learning a shallow neural network, called the Ethical Module, which transforms the deep embeddings of a pre-trained model in order to give more representation power to the disadvantaged subgroups. Its training is supervised by the von Mises-Fisher loss, whose hyperparameters allow to control the space allocated to each subgroup in the latent space. Besides being very simple, the resulting methodology is more stable and faster than most current bias mitigation methods. In order to illustrate our idea in a concrete use case, we focus here on gender bias in facial recognition and conduct extensive numerical experiments on standard datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Fair-SSL: Building fair ML Software with less data

2021-11-03 · Joymallya Chakraborty, Suvodeep Majumder, Huy Tu

Ethical bias in machine learning models has become a matter of concern in the software engineering community. Most of the prior software engineering works concentrated on finding ethical bias in models rather than fixing…

AttributeFairness

Gender Encoding Patterns in Pretrained Language Model Representations

2025-03-09 · Mahdi Zakizadeh, Mohammad Taher Pilehvar

Gender bias in pretrained language models (PLMs) poses significant social and ethical challenges. Despite growing awareness, there is a lack of comprehensive investigation into how different models internally represent a…

Language ModelingLanguage Modellingmodel

Sustainable Modular Debiasing of Language Models

2021-09-08 · Findings (EMNLP) 2021 11 · Anne Lauscher, Tobias Lüken, Goran Glavaš

Unfair stereotypical biases (e.g., gender, racial, or religious biases) encoded in modern pretrained language models (PLMs) have negative ethical implications for widespread adoption of state-of-the-art language technolo…

FairnessLanguage ModelingLanguage Modelling

Eagle: Ethical Dataset Given from Real Interactions

2024-02-22 · Masahiro Kaneko, Danushka Bollegala, Timothy Baldwin

Recent studies have demonstrated that large language models (LLMs) have ethical-related problems such as social biases, lack of moral reasoning, and generation of offensive content. The existing evaluation metrics and me…

Ethical Framework for Responsible Foundational Models in Medical Imaging

2024-04-14 · Abhijit Das, Debesh Jha, Jasmer Sanjotra, Onkar Susladkar 외

Foundational models (FMs) have tremendous potential to revolutionize medical imaging. However, their deployment in real-world clinical settings demands extensive ethical considerations. This paper aims to highlight the e…