paper-with-me

홈 › Papers

Fairness Increases Adversarial Vulnerability

2022-11-21 · Cuong Tran, Keyu Zhu, Ferdinando Fioretto, Pascal Van Hentenryck

The remarkable performance of deep learning models and their applications in consequential domains (e.g., facial recognition) introduces important challenges at the intersection of equity and security. Fairness and robustness are two desired notions often required in learning models. Fairness ensures that models do not disproportionately harm (or benefit) some groups over others, while robustness measures the models' resilience against small input perturbations. This paper shows the existence of a dichotomy between fairness and robustness, and analyzes when achieving fairness decreases the model robustness to adversarial samples. The reported analysis sheds light on the factors causing such contrasting behavior, suggesting that distance to the decision boundary across groups as a key explainer for this behavior. Extensive experiments on non-linear models and different architectures validate the theoretical findings in multiple vision domains. Finally, the paper proposes a simple, yet effective, solution to construct models achieving good tradeoffs between fairness and robustness.

📄 PDF Abstract BibTeX arXiv:2211.11835

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Adversarial Inter-Group Link Injection Degrades the Fairness of Graph Neural Networks

2022-09-13 · Hussain Hussain, Meng Cao, Sandipan Sikdar, Denis Helic 외

We present evidence for the existence and effectiveness of adversarial attacks on graph neural networks (GNNs) that aim to degrade fairness. These attacks can disadvantage a particular subgroup of nodes in GNN-based node…

FairnessNode Classification

Adversarial Vulnerability of Neural Networks Increases with Input Dimension

2019-05-01 · ICLR 2019 5 · Carl-Johann Simon-Gabriel, Yann Ollivier, Léon Bottou, Bernhard Schölkopf 외

Over the past four years, neural networks have been proven vulnerable to adversarial images: targeted but imperceptible image perturbations lead to drastically different predictions. We show that adversarial vulnerabilit…

On the Vulnerability of Fairness Constrained Learning to Malicious Noise

2023-07-21 · Avrim Blum, Princewill Okoroafor, Aadirupa Saha, Kevin Stangl

We consider the vulnerability of fairness-constrained learning to small amounts of malicious noise in the training data. Konstantinov and Lampert (2021) initiated the study of this question and presented negative results…

Fairness

Mitigating Membership Inference Vulnerability in Personalized Federated Learning

2025-03-12 · Kangsoo Jung, Sayan Biswas, Catuscia Palamidessi

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training without the need to share clients' personal data, thereby preserving privacy. However, the non-IID nature of the clients' data …

ClusteringFairnessFederated LearningPersonalized Federated Learning

Publishing Efficient On-device Models Increases Adversarial Vulnerability

2022-12-28 · Sanghyun Hong, Nicholas Carlini, Alexey Kurakin

Recent increases in the computational demands of deep neural networks (DNNs) have sparked interest in efficient deep learning mechanisms, e.g., quantization or pruning. These mechanisms enable the construction of a small…

Quantization