paper-with-me

Papers

Deep k-NN Defense against Clean-label Data Poisoning Attacks

2019-09-29 · Neehar Peri, Neal Gupta, W. Ronny Huang, Liam Fowl, Chen Zhu, Soheil Feizi, Tom Goldstein, John P. Dickerson

Targeted clean-label data poisoning is a type of adversarial attack on machine learning systems in which an adversary injects a few correctly-labeled, minimally-perturbed samples into the training data, causing a model to misclassify a particular test sample during inference. Although defenses have been proposed for general poisoning attacks, no reliable defense for clean-label attacks has been demonstrated, despite the attacks' effectiveness and realistic applications. In this work, we propose a simple, yet highly-effective Deep k-NN defense against both feature collision and convex polytope clean-label attacks on the CIFAR-10 dataset. We demonstrate that our proposed strategy is able to detect over 99% of poisoned examples in both attacks and remove them without compromising model performance. Additionally, through ablation studies, we discover simple guidelines for selecting the value of k as well as for implementing the Deep k-NN defense on real-world datasets with class imbalance. Our proposed defense shows that current clean-label poisoning attack strategies can be annulled, and serves as a strong yet simple-to-implement baseline defense to test future clean-label poisoning attacks. Our code is available at https://github.com/neeharperi/DeepKNNDefense

📄 PDF Abstract BibTeX arXiv:1909.13374

Code (1)

neeharperi/DeepKNNDefense 공식 구현 pytorch

Tasks

Adversarial AttackData Poisoning

Methods 이 논문이 사용한 방법론

Test 설명 없음
k-NN $k$-Nearest Neighbors is a clustering-based algorithm for classification and regression. It is a a type of instance-based learning as it does not attempt to construct a…

Similar Papers 제목 키워드 기반

Certified Robustness to Clean-Label Poisoning Using Diffusion Denoising

2024-03-18 · Sanghyun Hong, Nicholas Carlini, Alexey Kurakin

We present a certified defense to clean-label poisoning attacks under $\ell_2$-norm. These attacks work by injecting a small number of poisoning samples (e.g., 1%) that contain bounded adversarial perturbations into the …

Adversarial RobustnessDenoising

Clean Label Attacks against SLU Systems

2024-09-13 · Henry Li Xinyuan, Sonal Joshi, Thomas Thebaud, Jesus Villalba 외

Poisoning backdoor attacks involve an adversary manipulating the training data to induce certain behaviors in the victim model by inserting a trigger in the signal at inference time. We adapted clean label backdoor (CLBD…

Data Poisoningspeech-recognitionSpeech RecognitionSpoken Language Understanding

Checkerboard: Closed-Form and Data-Independent Trigger Design for Clean-Label Backdoor Attacks

2026-05-02 · Yi Yang, Jinyang Huang, Binbin Liu, Feng-Qi Cui 외 arxiv

Backdoor attacks threaten the deep-learning supply chain by poisoning a small fraction of the training data so that a model behaves normally on clean inputs but maps triggered inputs to an attacker-chosen class. Clean-la…

PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learning

2022-05-13 · Hongbin Liu, Jinyuan Jia, Neil Zhenqiang Gong

Contrastive learning pre-trains an image encoder using a large amount of unlabeled data such that the image encoder can be used as a general-purpose feature extractor for various downstream tasks. In this work, we propos…

Bilevel OptimizationContrastive LearningData Poisoning

De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks

2021-05-08 · Jian Chen, Xuxin Zhang, Rui Zhang, Chen Wang 외

Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by inject…

Data AugmentationData Poisoning