paper-with-me

Papers

Poisoning Attacks on Fair Machine Learning

2021-10-17 · Minh-Hao Van, Wei Du, Xintao Wu, Aidong Lu

Both fair machine learning and adversarial learning have been extensively studied. However, attacking fair machine learning models has received less attention. In this paper, we present a framework that seeks to effectively generate poisoning samples to attack both model accuracy and algorithmic fairness. Our attacking framework can target fair machine learning models trained with a variety of group based fairness notions such as demographic parity and equalized odds. We develop three online attacks, adversarial sampling , adversarial labeling, and adversarial feature modification. All three attacks effectively and efficiently produce poisoning samples via sampling, labeling, or modifying a fraction of training data in order to reduce the test accuracy. Our framework enables attackers to flexibly adjust the attack's focus on prediction accuracy or fairness and accurately quantify the impact of each candidate point to both accuracy loss and fairness violation, thus producing effective poisoning samples. Experiments on two real datasets demonstrate the effectiveness and efficiency of our framework.

📄 PDF Abstract BibTeX arXiv:2110.08932

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningFairness

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Poisoning Attacks on Algorithmic Fairness

2020-04-15 · David Solans, Battista Biggio, Carlos Castillo

Research in adversarial machine learning has shown how the performance of machine learning models can be seriously compromised by injecting even a small fraction of poisoning points into the training data. While the effe…

BIG-bench Machine LearningFairness

Towards Poisoning Fair Representations

2023-09-28 · Tianci Liu, Haoyu Wang, Feijie Wu, Hengtong Zhang 외

Fair machine learning seeks to mitigate model prediction bias against certain demographic subgroups such as elder and female. Recently, fair representation learning (FRL) trained by deep neural networks has demonstrated …

Bilevel OptimizationData PoisoningFairnessRepresentation Learning

Towards Fair Classification against Poisoning Attacks

2022-10-18 · Han Xu, Xiaorui Liu, Yuxuan Wan, Jiliang Tang

Fair classification aims to stress the classification models to achieve the equality (treatment or prediction quality) among different sensitive groups. However, fair classification can be under the risk of poisoning att…

ClassificationFairness

Exacerbating Algorithmic Bias through Fairness Attacks

2020-12-16 · Ninareh Mehrabi, Muhammad Naveed, Fred Morstatter, Aram Galstyan

Algorithmic fairness has attracted significant attention in recent years, with many quantitative measures suggested for characterizing the fairness of different machine learning algorithms. Despite this interest, the rob…

Adversarial AttackBIG-bench Machine LearningData PoisoningFairness

Just How Toxic is Data Poisoning? A Benchmark for Backdoor and Data Poisoning Attacks

2021-01-01 · Avi Schwarzschild, Micah Goldblum, Arjun Gupta, John P Dickerson 외

Data poisoning and backdoor attacks manipulate training data in order to cause models to fail during inference. A recent survey of industry practitioners found that data poisoning is the number one concern among threats…

Data PoisoningExperimental Design