paper-with-me

홈 › Papers

Identity-Focused Inference and Extraction Attacks on Diffusion Models

2024-10-14 · Jayneel Vora, Aditya Krishnan, Nader Bouacida, Prabhu RV Shankar, Prasant Mohapatra

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity inference framework to hold model owners accountable for including individuals' identities in their training data. Our approach moves beyond traditional membership inference attacks by focusing on identity-level inference, providing a new perspective on data privacy violations. Through comprehensive evaluations on two facial image datasets, Labeled Faces in the Wild (LFW) and CelebA, our experiments demonstrate that the proposed membership inference attack surpasses baseline methods, achieving an attack success rate of up to 89% and an AUC-ROC of 0.91, while the identity inference attack attains 92% on LDM models trained on LFW, and the data extraction attack achieves 91.6% accuracy on DDPMs, validating the effectiveness of our approach across diffusion models.

📄 PDF Abstract BibTeX arXiv:2410.10177

Code (0)

등록된 구현이 없습니다.

Tasks

Inference AttackMembership Inference Attack

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Training for Identity, Inference for Controllability: A Unified Approach to Tuning-Free Face Personalization

2025-12-03 · Lianyu Pang, Ji Zhou, Qiping Wang, Baoquan Zhao 외 arxiv

Tuning-free face personalization methods have developed along two distinct paradigms: text embedding approaches that map facial features into the text embedding space, and adapter-based methods that inject features throu…

PIDiff: Image Customization for Personalized Identities with Diffusion Models

2025-05-08 · Jinyu Gu, Haipeng Liu, Meng Wang, Yang Wang

Text-to-image generation for personalized identities aims at incorporating the specific identity into images using a text prompt and an identity image. Based on the powerful generative capabilities of DDPMs, many previou…

Image GenerationText to Image GenerationText-to-Image Generation

S$^2$Edit: Text-Guided Image Editing with Precise Semantic and Spatial Control

2025-07-07 · Xudong Liu, Zikun Chen, Ruowei Jiang, Ziyi Wu 외

Recent advances in diffusion models have enabled high-quality generation and manipulation of images guided by texts, as well as concept learning from images. However, naive applications of existing methods to editing tas…

text-guided-image-editing

Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization

2025-10-28 · Haoxin Yang, Yihong Lin, Jingdan Kang, Xuemiao Xu 외 arxiv

Face anonymization aims to conceal identity information while preserving non-identity attributes. Mainstream diffusion models rely on inference-time interventions such as negative guidance or energy-based optimization, w…

Face Anonymization

SAP-DIFF: Semantic Adversarial Patch Generation for Black-Box Face Recognition Models via Diffusion Models

2025-02-27 · Mingsi Wang, Shuaiyin Yao, Chang Yue, Lijie Zhang 외

Given the need to evaluate the robustness of face recognition (FR) models, many efforts have focused on adversarial patch attacks that mislead FR models by introducing localized perturbations. Impersonation attacks are a…

Face Recognition