paper-with-me

홈 › Papers

Extracting Training Data from Diffusion Models

2023-01-30 · Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace

Image diffusion models such as DALL-E 2, Imagen, and Stable Diffusion have attracted significant attention due to their ability to generate high-quality synthetic images. In this work, we show that diffusion models memorize individual images from their training data and emit them at generation time. With a generate-and-filter pipeline, we extract over a thousand training examples from state-of-the-art models, ranging from photographs of individual people to trademarked company logos. We also train hundreds of diffusion models in various settings to analyze how different modeling and data decisions affect privacy. Overall, our results show that diffusion models are much less private than prior generative models such as GANs, and that mitigating these vulnerabilities may require new advances in privacy-preserving training.

📄 PDF Abstract BibTeX arXiv:2301.13188

Code (1)

vita-group/shake-to-leak pytorch

Tasks

Privacy Preserving

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

OSI: One-step Inversion Excels in Extracting Diffusion Watermarks

2026-02-10 · Yuwei Chen, Zhenliang He, Jia Tang, Meina Kan 외 arxiv

Watermarking is an important mechanism for provenance and copyright protection of diffusion-generated images. Training-free methods, exemplified by Gaussian Shading, embed watermarks into the initial noise of diffusion m…

Guidance for Low-Level Perceptual Editing in Unconditional Diffusion Models

2026-05-29 · Shreyansh Modi, Akshat Tomar, Aarush Aggarwal arxiv

Unconditional diffusion models offer powerful generative priors, yet steering them toward aesthetically enhanced outputs remains largely unexplored. We show that h-space patching, the dominant paradigm for training-free …

Extracting Reward Functions from Diffusion Models

2023-06-01 · NeurIPS 2023 11 · Felipe Nuti, Tim Franzmeyer, João F. Henriques

Diffusion models have achieved remarkable results in image generation, and have similarly been used to learn high-performing policies in sequential decision-making tasks. Decision-making diffusion models can be trained o…

Decision MakingImage GenerationSequential Decision Making

JieHua Paintings Style Feature Extracting Model using Stable Diffusion with ControlNet

2024-08-21 · Yujia Gu, Haofeng Li, Xinyu Fang, Zihan Peng 외

This study proposes a novel approach to extract stylistic features of Jiehua: the utilization of the Fine-tuned Stable Diffusion Model with ControlNet (FSDMC) to refine depiction techniques from artists' Jiehua. The trai…

Style Transfer

Offline Adaptation of Quadruped Locomotion using Diffusion Models

2024-11-13 · Reece O'Mahoney, Alexander L. Mitchell, Wanming Yu, Ingmar Posner 외

We present a diffusion-based approach to quadrupedal locomotion that simultaneously addresses the limitations of learning and interpolating between multiple skills and of (modes) offline adapting to new locomotion behavi…

CPU