paper-with-me

홈 › Papers

Label Poisoning is All You Need

2023-10-29 · NeurIPS 2023 11

In a backdoor attack, an adversary injects corrupted data into a model's training dataset in order to gain control over its predictions on images with a specific attacker-defined trigger. A typical corrupted training example requires altering both the image, by applying the trigger, and the label. Models trained on clean images, therefore, were considered safe from backdoor attacks. However, in some common machine learning scenarios, the training labels are provided by potentially malicious third-parties. This includes crowd-sourced annotation and knowledge distillation. We, hence, investigate a fundamental question: can we launch a successful backdoor attack by only corrupting labels? We introduce a novel approach to design label-only backdoor attacks, which we call FLIP, and demonstrate its strengths on three datasets (CIFAR-10, CIFAR-100, and Tiny-ImageNet) and four architectures (ResNet-32, ResNet-18, VGG-19, and Vision Transformer). With only 2% of CIFAR-10 labels corrupted, FLIP achieves a near-perfect attack success rate of 99.4% while suffering only a 1.8% drop in the clean test accuracy. Our approach builds upon the recent advances in trajectory matching, originally introduced for dataset distillation.

📄 PDF Abstract BibTeX arXiv:2310.18933

Code (1)

SewoongLab/FLIP 공식 구현 pytorch

Tasks

AllBackdoor AttackDataset DistillationKnowledge Distillation

Methods 이 논문이 사용한 방법론

FLIP https://developer.nvidia.com/blog/flip-a-difference-evaluator-for-alternating-images/
VGG-19 설명 없음

Similar Papers 제목 키워드 기반

Certified Robustness to Clean-Label Poisoning Using Diffusion Denoising

2024-03-18 · Sanghyun Hong, Nicholas Carlini, Alexey Kurakin

We present a certified defense to clean-label poisoning attacks under $\ell_2$-norm. These attacks work by injecting a small number of poisoning samples (e.g., 1%) that contain bounded adversarial perturbations into the …

Adversarial RobustnessDenoising

Hard Work Does Not Always Pay Off: Poisoning Attacks on Neural Architecture Search

2024-05-09 · Zachary Coalson, Huazheng Wang, Qingyun Wu, Sanghyun Hong

In this paper, we study the robustness of "data-centric" approaches to finding neural network architectures (known as neural architecture search) to data distribution shifts. To audit this robustness, we present a data p…

Data PoisoningNeural Architecture Search

Poisoning Semi-supervised Federated Learning via Unlabeled Data: Attacks and Defenses

2020-12-08 · Yi Liu, Xingliang Yuan, Ruihui Zhao, Cong Wang 외

Semi-supervised Federated Learning (SSFL) has recently drawn much attention due to its practical consideration, i.e., the clients may only have unlabeled data. In practice, these SSFL systems implement semi-supervised tr…

Federated LearningQuantization

FRIB: Low-poisoning Rate Invisible Backdoor Attack based on Feature Repair

2022-07-26 · Hui Xia, Xiugui Yang, Xiangyun Qian, Rui Zhang

During the generation of invisible backdoor attack poisoned data, the feature space transformation operation tends to cause the loss of some poisoned features and weakens the mapping relationship between source images wi…

Backdoor Attack

Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networks

2018-04-03 · NeurIPS 2018 12 · Ali Shafahi, W. Ronny Huang, Mahyar Najibi, Octavian Suciu 외

Data poisoning is an attack on machine learning models wherein the attacker adds examples to the training set to manipulate the behavior of the model at test time. This paper explores poisoning attacks on neural nets. Th…

Data PoisoningFace RecognitionTransfer Learning