paper-with-me

Papers

Adversarial Examples are Misaligned in Diffusion Model Manifolds

2024-01-12 · Peter Lorenz, Ricard Durall, Janis Keuper

In recent years, diffusion models (DMs) have drawn significant attention for their success in approximating data distributions, yielding state-of-the-art generative results. Nevertheless, the versatility of these models extends beyond their generative capabilities to encompass various vision applications, such as image inpainting, segmentation, adversarial robustness, among others. This study is dedicated to the investigation of adversarial attacks through the lens of diffusion models. However, our objective does not involve enhancing the adversarial robustness of image classifiers. Instead, our focus lies in utilizing the diffusion model to detect and analyze the anomalies introduced by these attacks on images. To that end, we systematically examine the alignment of the distributions of adversarial examples when subjected to the process of transformation using diffusion models. The efficacy of this approach is assessed across CIFAR-10 and ImageNet datasets, including varying image sizes in the latter. The results demonstrate a notable capacity to discriminate effectively between benign and attacked images, providing compelling evidence that adversarial instances do not align with the learned manifold of the DMs.

📄 PDF Abstract BibTeX arXiv:2401.06637

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial RobustnessImage Inpaintingmodel

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Focus 설명 없음

Similar Papers 제목 키워드 기반

On-Manifold Projected Gradient Descent

2023-08-23 · Aaron Mahler, Tyrus Berry, Tom Stephens, Harbir Antil 외

This work provides a computable, direct, and mathematically rigorous approximation to the differential geometry of class manifolds for high-dimensional data, along with nonlinear projections from input space onto these c…

Adversarial Attack

On Convolutions, Intrinsic Dimension, and Diffusion Models

2025-06-25 · Kin Kwan Leung, Rasa Hosseinzadeh, Gabriel Loaiza-Ganem

The manifold hypothesis asserts that data of interest in high-dimensional ambient spaces, such as image data, lies on unknown low-dimensional submanifolds. Diffusion models (DMs) -- which operate by convolving data with …

Examining the Proximity of Adversarial Examples to Class Manifolds in Deep Networks

2022-04-12 · Štefan Pócoš, Iveta Bečková, Igor Farkaš

Deep neural networks achieve remarkable performance in multiple fields. However, after proper training they suffer from an inherent vulnerability against adversarial examples (AEs). In this work we shed light on inner re…

image-classificationImage Classification

Reproducing kernel Hilbert spaces on manifolds: Sobolev and Diffusion spaces

2019-05-27 · Ernesto De Vito, Nicole Mücke, Lorenzo Rosasco

We study reproducing kernel Hilbert spaces (RKHS) on a Riemannian manifold. In particular, we discuss under which condition Sobolev spaces are RKHS and characterize their reproducing kernels. Further, we introduce and di…

On the Geometry of Adversarial Examples

2018-11-01 · ICLR 2019 5 · Marc Khoury, Dylan Hadfield-Menell

Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. We propose a geo…