paper-with-me

Papers

Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning

2023-04-04 · CVPR 2023 1 · Ajinkya Tejankar, Maziar Sanjabi, Qifan Wang, Sinong Wang, Hamed Firooz, Hamed Pirsiavash, Liang Tan

Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the unlabeled data so that when a victim trains an SSL model on it, the final model will have a backdoor that the adversary can exploit. This work aims to defend self-supervised learning against such attacks. We use a three-step defense pipeline, where we first train a model on the poisoned data. In the second step, our proposed defense algorithm (PatchSearch) uses the trained model to search the training data for poisoned samples and removes them from the training set. In the third step, a final model is trained on the cleaned-up training set. Our results show that PatchSearch is an effective defense. As an example, it improves a model's accuracy on images containing the trigger from 38.2% to 63.7% which is very close to the clean model's accuracy, 64.6%. Moreover, we show that PatchSearch outperforms baselines and state-of-the-art defense approaches including those using additional clean, trusted data. Our code is available at https://github.com/UCDvision/PatchSearch

📄 PDF Abstract BibTeX arXiv:2304.01482

Code (2)

ucdvision/patchsearch 공식 구현 pytorch
jsrdcht/SSL-Backdoor pytorch

Tasks

Data PoisoningSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Defending Backdoor Attacks on Vision Transformer via Patch Processing

2022-06-24 · Khoa D. Doan, Yingjie Lao, Peng Yang, Ping Li

Vision Transformers (ViTs) have a radically different architecture with significantly less inductive bias than Convolutional Neural Networks. Along with the improvement in performance, security and robustness of ViTs are…

Backdoor AttackInductive Bias

ONION: A Simple and Effective Defense Against Textual Backdoor Attacks

2020-11-20 · EMNLP 2021 11 · Fanchao Qi, Yangyi Chen, Mukai Li, Yuan YAO 외

Backdoor attacks are a kind of emergent training-time threat to deep neural networks (DNNs). They can manipulate the output of DNNs and possess high insidiousness. In the field of natural language processing, some attack…

Backdoor Attackbackdoor defense

Towards Understanding How Self-training Tolerates Data Backdoor Poisoning

2023-01-20 · Soumyadeep Pal, Ren Wang, Yuguang Yao, Sijia Liu

Recent studies on backdoor attacks in model training have shown that polluting a small portion of training data is sufficient to produce incorrect manipulated predictions on poisoned test-time data while maintaining high…

backdoor defenseRepresentation Learning

Defending Against Backdoor Attacks in Natural Language Generation

2021-06-03 · Xiaofei Sun, Xiaoya Li, Yuxian Meng, Xiang Ao 외

The frustratingly fragile nature of neural network models make current natural language generation (NLG) systems prone to backdoor attacks and generate malicious sequences that could be sexist or offensive. Unfortunately…

Backdoor AttackDialogue GenerationMachine TranslationText Generation+1

Defending Text-to-image Diffusion Models: Surprising Efficacy of Textual Perturbations Against Backdoor Attacks

2024-08-28 · Oscar Chew, Po-Yi Lu, Jayden Lin, Hsuan-Tien Lin

Text-to-image diffusion models have been widely adopted in real-world applications due to their ability to generate realistic images from textual descriptions. However, recent studies have shown that these methods are vu…

backdoor defense