paper-with-me

홈 › Papers

Towards A Proactive ML Approach for Detecting Backdoor Poison Samples

2022-05-26 · Xiangyu Qi, Tinghao Xie, Jiachen T. Wang, Tong Wu, Saeed Mahloujifar, Prateek Mittal

Adversaries can embed backdoors in deep learning models by introducing backdoor poison samples into training datasets. In this work, we investigate how to detect such poison samples to mitigate the threat of backdoor attacks. First, we uncover a post-hoc workflow underlying most prior work, where defenders passively allow the attack to proceed and then leverage the characteristics of the post-attacked model to uncover poison samples. We reveal that this workflow does not fully exploit defenders' capabilities, and defense pipelines built on it are prone to failure or performance degradation in many scenarios. Second, we suggest a paradigm shift by promoting a proactive mindset in which defenders engage proactively with the entire model training and poison detection pipeline, directly enforcing and magnifying distinctive characteristics of the post-attacked model to facilitate poison detection. Based on this, we formulate a unified framework and provide practical insights on designing detection pipelines that are more robust and generalizable. Third, we introduce the technique of Confusion Training (CT) as a concrete instantiation of our framework. CT applies an additional poisoning attack to the already poisoned dataset, actively decoupling benign correlation while exposing backdoor patterns to detection. Empirical evaluations on 4 datasets and 14 types of attacks validate the superiority of CT over 14 baseline defenses.

📄 PDF Abstract BibTeX arXiv:2205.13616

Code (1)

unispac/fight-poison-with-poison 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Mitigating Backdoor Attack by Injecting Proactive Defensive Backdoor

2024-05-25 · Shaokui Wei, Hongyuan Zha, Baoyuan Wu

Data-poisoning backdoor attacks are serious security threats to machine learning models, where an adversary can manipulate the training dataset to inject backdoors into models. In this paper, we focus on in-training back…

Backdoor Attackbackdoor defenseData Poisoning

Backdoor Defense via Test-Time Detecting and Repairing

2024-01-01 · CVPR 2024 1 · Jiyang Guan, Jian Liang, Ran He

Deep neural networks have played a crucial part in many critical domains such as autonomous driving face recognition and medical diagnosis. However deep neural networks are facing security threats from backdoor attac…

Autonomous Drivingbackdoor defenseFace RecognitionMedical Diagnosis

Poison as a Cure: Detecting & Neutralizing Variable-Sized Backdoor Attacks in Deep Neural Networks

2019-11-19 · Alvin Chan, Yew-Soon Ong

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigge…

Detecting Backdoor Samples in Contrastive Language Image Pretraining

2025-02-03 · Hanxun Huang, Sarah Erfani, Yige Li, Xingjun Ma 외

Contrastive language-image pretraining (CLIP) has been found to be vulnerable to poisoning backdoor attacks where the adversary can achieve an almost perfect attack success rate on CLIP models by poisoning only 0.01\% of…

Test-Time Backdoor Detection for Object Detection Models

2025-03-19 · CVPR 2025 1 · Hangtao Zhang, Yichen Wang, Shihui Yan, Chenyu Zhu 외

Object detection models are vulnerable to backdoor attacks, where attackers poison a small subset of training samples by embedding a predefined trigger to manipulate prediction. Detecting poisoned samples (i.e., those co…

image-classificationImage ClassificationObjectobject-detection+1