paper-with-me

Papers

Random Sampling for Diffusion-based Adversarial Purification

2024-11-28 · Jiancheng Zhang, Peiran Dong, Yongyong Chen, Yin-Ping Zhao, Song Guo

Denoising Diffusion Probabilistic Models (DDPMs) have gained great attention in adversarial purification. Current diffusion-based works focus on designing effective condition-guided mechanisms while ignoring a fundamental problem, i.e., the original DDPM sampling is intended for stable generation, which may not be the optimal solution for adversarial purification. Inspired by the stability of the Denoising Diffusion Implicit Model (DDIM), we propose an opposite sampling scheme called random sampling. In brief, random sampling will sample from a random noisy space during each diffusion process, while DDPM and DDIM sampling will continuously sample from the adjacent or original noisy space. Thus, random sampling obtains more randomness and achieves stronger robustness against adversarial attacks. Correspondingly, we also introduce a novel mediator conditional guidance to guarantee the consistency of the prediction under the purified image and clean image input. To expand awareness of guided diffusion purification, we conduct a detailed evaluation with different sampling methods and our random sampling achieves an impressive improvement in multiple settings. Leveraging mediator-guided random sampling, we also establish a baseline method named DiffAP, which significantly outperforms state-of-the-art (SOTA) approaches in performance and defensive stability. Remarkably, under strong attack, our DiffAP even achieves a more than 20% robustness advantage with 10$\times$ sampling acceleration.

📄 PDF Abstract BibTeX arXiv:2411.18956

Code (1)

ZhangJC-2k/RandomSampling 공식 구현 pytorch

Tasks

Adversarial PurificationDenoising

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness

2023-10-28 · Boya Zhang, Weijian Luo, Zhihua Zhang

Adversarial attacks can mislead neural network classifiers. The defense against adversarial attacks is important for AI safety. Adversarial purification is a family of approaches that defend adversarial attacks with suit…

Adversarial Purification

Guided Diffusion Model for Adversarial Purification from Random Noise

2022-06-22 · Quanlin Wu, Hang Ye, Yuntian Gu

In this paper, we propose a novel guided diffusion purification approach to provide a strong defense against adversarial attacks. Our model achieves 89.62% robust accuracy under PGD-L_inf attack (eps = 8/255) on the CIFA…

Adversarial Purification

How Do Diffusion Models Improve Adversarial Robustness?

2025-05-28 · Liu Yuezhang, Xue-Xin Wei

Recent findings suggest that diffusion models significantly enhance empirical adversarial robustness. While some intuitive explanations have been proposed, the precise mechanisms underlying these improvements remain uncl…

Adversarial PurificationAdversarial Robustness

Divide and Conquer: Heterogeneous Noise Integration for Diffusion-based Adversarial Purification

2025-01-01 · CVPR 2025 1 · Gaozheng Pei, Shaojie Lyu, Gong Chen, Ke Ma 외

Existing diffusion-based purification methods aim to disrupt adversarial perturbations by introducing a certain amount of noise through a forward diffusion process, followed by a reverse process to recover clean exam…

Adversarial Purification

Robust Evaluation of Diffusion-Based Adversarial Purification

2023-03-16 · ICCV 2023 1 · Minjong Lee, Dongwoo Kim

We question the current evaluation practice on diffusion-based purification methods. Diffusion-based purification methods aim to remove adversarial effects from an input data point at test time. The approach gains increa…

Adversarial Purification