paper-with-me

홈 › Papers

UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Models

2024-04-01 · Zihan Guan, Mengxuan Hu, Sheng Li, Anil Vullikanti

Diffusion models are vulnerable to backdoor attacks, where malicious attackers inject backdoors by poisoning certain training samples during the training stage. This poses a significant threat to real-world applications in the Model-as-a-Service (MaaS) scenario, where users query diffusion models through APIs or directly download them from the internet. To mitigate the threat of backdoor attacks under MaaS, black-box input-level backdoor detection has drawn recent interest, where defenders aim to build a firewall that filters out backdoor samples in the inference stage, with access only to input queries and the generated results from diffusion models. Despite some preliminary explorations on the traditional classification tasks, these methods cannot be directly applied to the generative tasks due to two major challenges: (1) more diverse failures and (2) a multi-modality attack surface. In this paper, we propose a black-box input-level backdoor detection framework on diffusion models, called UFID. Our defense is motivated by an insightful causal analysis: Backdoor attacks serve as the confounder, introducing a spurious path from input to target images, which remains consistent even when we perturb the input samples with Gaussian noise. We further validate the intuition with theoretical analysis. Extensive experiments across different datasets on both conditional and unconditional diffusion models show that our method achieves superb performance on detection effectiveness and run-time efficiency.

📄 PDF Abstract BibTeX arXiv:2404.01101

Code (1)

guanzihan/official_ufid 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Adaptive Fidelity Estimation for Quantum Programs with Graph-Guided Noise Awareness

2026-01-21 · Tingting Li, Ziming Zhao, Jianwei Yin arxiv

Fidelity estimation is a critical yet resource-intensive step in testing quantum programs on noisy intermediate-scale quantum (NISQ) devices, where the required number of measurements is difficult to predefine due to har…

VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models

2023-06-12 · NeurIPS 2023 11 · Sheng-Yen Chou, Pin-Yu Chen, Tsung-Yi Ho

Diffusion Models (DMs) are state-of-the-art generative models that learn a reversible corruption process from iterative noise addition and denoising. They are the backbone of many generative AI applications, such as text…

Backdoor AttackDenoising

UNICORN: A Unified Backdoor Trigger Inversion Framework

2023-04-05 · Zhenting Wang, Kai Mei, Juan Zhai, Shiqing Ma

The backdoor attack, where the adversary uses inputs stamped with triggers (e.g., a patch) to activate pre-planted malicious behaviors, is a severe threat to Deep Neural Network (DNN) models. Trigger inversion is an effe…

Backdoor Attack

TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors

2024-09-09 · Yichuan Mo, Hui Huang, Mingjie Li, Ang Li 외

Diffusion models have achieved notable success in image generation, but they remain highly vulnerable to backdoor attacks, which compromise their integrity by producing specific undesirable outputs when presented with a …

backdoor defenseImage Generation

MixBridge: Heterogeneous Image-to-Image Backdoor Attack through Mixture of Schrödinger Bridges

2025-05-12 · Shixi Qin, Zhiyong Yang, Shilong Bao, Shi Wang 외

This paper focuses on implanting multiple heterogeneous backdoor triggers in bridge-based diffusion models designed for complex and arbitrary input distributions. Existing backdoor formulations mainly address single-atta…

Backdoor Attack