paper-with-me

홈 › Papers

DRAG: Data Reconstruction Attack using Guided Diffusion

2025-09-15 · Wa-Kin Lei, Jun-Cheng Chen, Shang-Tse Chen arxiv

With the rise of large foundation models, split inference (SI) has emerged as a popular computational paradigm for deploying models across lightweight edge devices and cloud servers, addressing data privacy and computational cost concerns. However, most existing data reconstruction attacks have focused on smaller CNN classification models, leaving the privacy risks of foundation models in SI settings largely unexplored. To address this gap, we propose a novel data reconstruction attack based on guided diffusion, which leverages the rich prior knowledge embedded in a latent diffusion model (LDM) pre-trained on a large-scale dataset. Our method performs iterative reconstruction on the LDM's learned image prior, effectively generating high-fidelity images resembling the original data from their intermediate representations (IR). Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods, both qualitatively and quantitatively, in reconstructing data from deep-layer IRs of the vision foundation model. The results highlight the urgent need for more robust privacy protection mechanisms for large models in SI scenarios. Code is available at: https://github.com/ntuaislab/DRAG.

📄 PDF Abstract BibTeX arXiv:2509.11724

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DRAGD: A Federated Unlearning Data Reconstruction Attack Based on Gradient Differences

2025-07-13 · Bocheng Ju, Junchao Fan, Jiaqi Liu, Xiaolin Chang

Federated learning enables collaborative machine learning while preserving data privacy. However, the rise of federated unlearning, designed to allow clients to erase their data from the global model, introduces new priv…

Federated LearningReconstruction Attack

InstructUDrag: Joint Text Instructions and Object Dragging for Interactive Image Editing

2025-10-09 · Haoran Yu, Yi Shi arxiv

Text-to-image diffusion models have shown great potential for image editing, with techniques such as text-based and object-dragging methods emerging as key approaches. However, each of these methods has inherent limitati…

Text-based Image EditingImage Reconstruction

On the Controllability-Fidelity Frontier in Diffusion Editing

2026-06-05 · Yi Hu, Leying Yi, Emily Davis, Finn Carter arxiv

Diffusion-based generative models enable powerful image editing capabilities, but achieving precise control while maintaining fidelity and safety remains challenging. We present a comprehensive theoretical and empirical …

Image Editing

TDEdit: A Unified Diffusion Framework for Text-Drag Guided Image Manipulation

2025-09-26 · Qihang Wang, Yaxiong Wang, Lechao Cheng, Zhun Zhong arxiv

This paper explores image editing under the joint control of text and drag interactions. While recent advances in text-driven and drag-driven editing have achieved remarkable progress, they suffer from complementary limi…

Image ManipulationImage Editing

Drag-guided diffusion models for vehicle image generation

2023-06-16 · Nikos Arechiga, Frank Permenter, Binyang Song, Chenyang Yuan

Denoising diffusion models trained at web-scale have revolutionized image generation. The application of these tools to engineering design is an intriguing possibility, but is currently limited by their inability to pars…

DenoisingImage Generation