paper-with-me

홈 › Papers

Model Debiasing via Gradient-based Explanation on Representation

2023-05-20 · Jindi Zhang, Luning Wang, Dan Su, Yongxiang Huang, Caleb Chen Cao, Lei Chen

Machine learning systems produce biased results towards certain demographic groups, known as the fairness problem. Recent approaches to tackle this problem learn a latent code (i.e., representation) through disentangled representation learning and then discard the latent code dimensions correlated with sensitive attributes (e.g., gender). Nevertheless, these approaches may suffer from incomplete disentanglement and overlook proxy attributes (proxies for sensitive attributes) when processing real-world data, especially for unstructured data, causing performance degradation in fairness and loss of useful information for downstream tasks. In this paper, we propose a novel fairness framework that performs debiasing with regard to both sensitive attributes and proxy attributes, which boosts the prediction performance of downstream task models without complete disentanglement. The main idea is to, first, leverage gradient-based explanation to find two model focuses, 1) one focus for predicting sensitive attributes and 2) the other focus for predicting downstream task labels, and second, use them to perturb the latent code that guides the training of downstream task models towards fairness and utility goals. We show empirically that our framework works with both disentangled and non-disentangled representation learning methods and achieves better fairness-accuracy trade-off on unstructured and structured datasets than previous state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2305.12178

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementFairnessmodelRepresentation Learning

Similar Papers 제목 키워드 기반

ADEPT: A DEbiasing PrompT Framework

2022-11-10 · Ke Yang, Charles Yu, Yi Fung, Manling Li 외

Several works have proven that finetuning is an applicable approach for debiasing contextualized word embeddings. Similarly, discrete prompts with semantic meanings have shown to be effective in debiasing tasks. With unf…

AttributeLanguage ModellingWord Embeddings

Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes

2024-02-03 · Isabel O. Gallegos, Ryan A. Rossi, Joe Barrow, Md Mehrab Tanjim 외

Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance…

Text GenerationZero-Shot Learning

Mitigating Dataset Bias by Using Per-sample Gradient

2022-05-31 · Sumyeong Ahn, Seongyoon Kim, Se-Young Yun

The performance of deep neural networks is strongly influenced by the training dataset setup. In particular, when attributes having a strong correlation with the target attribute are present, the trained model can provid…

Attribute

InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions

2022-10-14 · Bodhisattwa Prasad Majumder, Zexue He, Julian McAuley

Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information 'f…

Attribute

Debiasing Concept-based Explanations with Causal Analysis

2020-07-22 · ICLR 2021 1 · Mohammad Taha Bahadori, David E. Heckerman

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we stu…