paper-with-me

Papers

Poisoning Attacks with Generative Adversarial Nets

2019-06-18 · Luis Muñoz-González, Bjarne Pfitzner, Matteo Russo, Javier Carnerero-Cano, Emil C. Lupu

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have already been proposed to evaluate worst-case scenarios, modelling attacks as a bi-level optimization problem. Solving these problems is computationally demanding and has limited applicability for some models such as deep networks. In this paper we introduce a novel generative model to craft systematic poisoning attacks against machine learning classifiers generating adversarial training examples, i.e. samples that look like genuine data points but that degrade the classifier's accuracy when used for training. We propose a Generative Adversarial Net with three components: generator, discriminator, and the target classifier. This approach allows us to model naturally the detectability constrains that can be expected in realistic attacks and to identify the regions of the underlying data distribution that can be more vulnerable to data poisoning. Our experimental evaluation shows the effectiveness of our attack to compromise machine learning classifiers, including deep networks.

📄 PDF Abstract BibTeX arXiv:1906.07773

Code (1)

lmunoz-gonzalez/Poisoning-Attacks-with-Back-gradient-Optimization

Tasks

BIG-bench Machine LearningData Poisoning

Similar Papers 제목 키워드 기반

From Trojan Horses to Castle Walls: Unveiling Bilateral Data Poisoning Effects in Diffusion Models

2023-11-04 · Zhuoshi Pan, Yuguang Yao, Gaowen Liu, Bingquan Shen 외

While state-of-the-art diffusion models (DMs) excel in image generation, concerns regarding their security persist. Earlier research highlighted DMs' vulnerability to data poisoning attacks, but these studies placed stri…

Backdoor Attackbackdoor defenseData Poisoningimage-classification+3

SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agents

2024-05-30 · Ethan Rathbun, Christopher Amato, Alina Oprea

Reinforcement learning (RL) is an actively growing field that is seeing increased usage in real-world, safety-critical applications -- making it paramount to ensure the robustness of RL algorithms against adversarial att…

Backdoor Attackreinforcement-learningReinforcement LearningReinforcement Learning (RL)

When and Where do Data Poisons Attack Textual Inversion?

2025-07-11 · Jeremy Styborski, Mingzhi Lyu, Jiayou Lu, Nupur Kapur 외

Poisoning attacks pose significant challenges to the robustness of diffusion models (DMs). In this paper, we systematically analyze when and where poisoning attacks textual inversion (TI), a widely used personalization t…

ML Attack Models: Adversarial Attacks and Data Poisoning Attacks

2021-12-06 · Jing Lin, Long Dang, Mohamed Rahouti, Kaiqi Xiong

Many state-of-the-art ML models have outperformed humans in various tasks such as image classification. With such outstanding performance, ML models are widely used today. However, the existence of adversarial attacks an…

Adversarial AttackData Poisoningimage-classificationImage Classification

PACOL: Poisoning Attacks Against Continual Learners

2023-11-18 · Huayu Li, Gregory Ditzler

Continual learning algorithms are typically exposed to untrusted sources that contain training data inserted by adversaries and bad actors. An adversary can insert a small number of poisoned samples, such as mislabeled s…

Continual LearningData PoisoningMisinformationOutlier Detection