paper-with-me

Papers

A Unified Detection Framework for Inference-Stage Backdoor Defenses

2023-09-21 · NeurIPS 2023 11

Backdoor attacks involve inserting poisoned samples during training, resulting in a model containing a hidden backdoor that can trigger specific behaviors without impacting performance on normal samples. These attacks are challenging to detect, as the backdoored model appears normal until activated by the backdoor trigger, rendering them particularly stealthy. In this study, we devise a unified inference-stage detection framework to defend against backdoor attacks. We first rigorously formulate the inference-stage backdoor detection problem, encompassing various existing methods, and discuss several challenges and limitations. We then propose a framework with provable guarantees on the false positive rate or the probability of misclassifying a clean sample. Further, we derive the most powerful detection rule to maximize the detection power, namely the rate of accurately identifying a backdoor sample, given a false positive rate under classical learning scenarios. Based on the theoretically optimal detection rule, we suggest a practical and effective approach for real-world applications based on the latent representations of backdoored deep nets. We extensively evaluate our method on 14 different backdoor attacks using Computer Vision (CV) and Natural Language Processing (NLP) benchmark datasets. The experimental findings align with our theoretical results. We significantly surpass the state-of-the-art methods, e.g., up to 300\% improvement on the detection power as evaluated by AUCROC, over the state-of-the-art defense against advanced adaptive backdoor attacks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Models

2024-04-01 · Zihan Guan, Mengxuan Hu, Sheng Li, Anil Vullikanti

Diffusion models are vulnerable to backdoor attacks, where malicious attackers inject backdoors by poisoning certain training samples during the training stage. This poses a significant threat to real-world applications …

BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents

2026-01-08 · Yunhao Feng, Yige Li, Yutao Wu, Yingshui Tan 외 arxiv

Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backd…

Detecting Backdoor in Deep Neural Networks via Intentional Adversarial Perturbations

2021-05-29 · Mingfu Xue, Yinghao Wu, Zhiyu Wu, Yushu Zhang 외

Recent researches show that deep learning model is susceptible to backdoor attacks. Many defenses against backdoor attacks have been proposed. However, existing defense works require high computational overhead or backdo…

Backdoor Attack

Towards Unified Robustness Against Both Backdoor and Adversarial Attacks

2024-05-28 · Zhenxing Niu, Yuyao Sun, Qiguang Miao, Rong Jin 외

Deep Neural Networks (DNNs) are known to be vulnerable to both backdoor and adversarial attacks. In the literature, these two types of attacks are commonly treated as distinct robustness problems and solved separately, s…

Adversarial DefenseAdversarial RobustnessBackdoor Attackbackdoor defense

BDetCLIP: Multimodal Prompting Contrastive Test-Time Backdoor Detection

2024-05-24 · Yuwei Niu, Shuo He, Qi Wei, Zongyu Wu 외

Multimodal contrastive learning methods (e.g., CLIP) have shown impressive zero-shot classification performance due to their strong ability to joint representation learning for visual and textual modalities. However, rec…

Contrastive LearningLanguage ModellingRepresentation Learningzero-shot-classification+1