paper-with-me

홈 › Papers

Benign Shortcut for Debiasing: Fair Visual Recognition via Intervention with Shortcut Features

2023-08-13 · Yi Zhang, Jitao Sang, Junyang Wang, Dongmei Jiang, YaoWei Wang

Machine learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, such as hiring, banking, and criminal justice. Existing work tackles this issue by minimizing the employed information about social attributes in models for debiasing. However, the high correlation between target task and these social attributes makes learning on the target task incompatible with debiasing. Given that model bias arises due to the learning of bias features (\emph{i.e}., gender) that help target task optimization, we explore the following research question: \emph{Can we leverage shortcut features to replace the role of bias feature in target task optimization for debiasing?} To this end, we propose \emph{Shortcut Debiasing}, to first transfer the target task's learning of bias attributes from bias features to shortcut features, and then employ causal intervention to eliminate shortcut features during inference. The key idea of \emph{Shortcut Debiasing} is to design controllable shortcut features to on one hand replace bias features in contributing to the target task during the training stage, and on the other hand be easily removed by intervention during the inference stage. This guarantees the learning of the target task does not hinder the elimination of bias features. We apply \emph{Shortcut Debiasing} to several benchmark datasets, and achieve significant improvements over the state-of-the-art debiasing methods in both accuracy and fairness.

📄 PDF Abstract BibTeX arXiv:2308.08482

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Causal Debiasing for Visual Commonsense Reasoning

2025-10-23 · Jiayi Zou, Gengyun Jia, Bing-Kun Bao arxiv

Visual Commonsense Reasoning (VCR) refers to answering questions and providing explanations based on images. While existing methods achieve high prediction accuracy, they often overlook bias in datasets and lack debiasin…

Visual Commonsense Reasoning

FairFlow: Mitigating Dataset Biases through Undecided Learning

2025-03-22 · Jiali Cheng, Hadi Amiri

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigat…

Towards Accuracy-Fairness Paradox: Adversarial Example-based Data Augmentation for Visual Debiasing

2020-07-27 · Yi Zhang, Jitao Sang

Machine learning fairness concerns about the biases towards certain protected or sensitive group of people when addressing the target tasks. This paper studies the debiasing problem in the context of image classification…

Adversarial AttackAttributeData AugmentationFairness+3

Fair Visual Recognition via Intervention with Proxy Features

2022-11-02 · Yi Zhang, Jitao Sang, Junyang Wang

Deep learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, e.g., hiring, banking, and …

Fairness

ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition

2025-01-31 · Joseph Fioresi, Ishan Rajendrakumar Dave, Mubarak Shah

Bias in machine learning models can lead to unfair decision making, and while it has been well-studied in the image and text domains, it remains underexplored in action recognition. Action recognition models often suffer…

Action RecognitionAutonomous Vehicles