paper-with-me

홈 › Papers

Unconditional Latent Diffusion Models Memorize Patient Imaging Data: Implications for Openly Sharing Synthetic Data

2024-02-01 · Salman Ul Hassan Dar, Marvin Seyfarth, Isabelle Ayx, Theano Papavassiliu, Stefan O. Schoenberg, Robert Malte Siepmann, Fabian Christopher Laqua, Jannik Kahmann, Norbert Frey, Bettina Baeßler, Sebastian Foersch, Daniel Truhn, Jakob Nikolas Kather, Sandy Engelhardt

AI models present a wide range of applications in the field of medicine. However, achieving optimal performance requires access to extensive healthcare data, which is often not readily available. Furthermore, the imperative to preserve patient privacy restricts patient data sharing with third parties and even within institutes. Recently, generative AI models have been gaining traction for facilitating open-data sharing by proposing synthetic data as surrogates of real patient data. Despite the promise, some of these models are susceptible to patient data memorization, where models generate patient data copies instead of novel synthetic samples. Considering the importance of the problem, surprisingly it has received relatively little attention in the medical imaging community. To this end, we assess memorization in unconditional latent diffusion models. We train latent diffusion models on CT, MR, and X-ray datasets for synthetic data generation. We then detect the amount of training data memorized utilizing our novel self-supervised copy detection approach and further investigate various factors that can influence memorization. Our findings show a surprisingly high degree of patient data memorization across all datasets. Comparison with non-diffusion generative models, such as autoencoders and generative adversarial networks, indicates that while latent diffusion models are more susceptible to memorization, overall they outperform non-diffusion models in synthesis quality. Further analyses reveal that using augmentation strategies, small architecture, and increasing dataset can reduce memorization while over-training the models can enhance it. Collectively, our results emphasize the importance of carefully training generative models on private medical imaging datasets, and examining the synthetic data to ensure patient privacy before sharing it for medical research and applications.

📄 PDF Abstract BibTeX arXiv:2402.01054

Code (1)

Cardio-AI/memorization-ldm 공식 구현 pytorch

Tasks

Copy DetectionData AugmentationImage GenerationMemorizationSynthetic Data Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesis

2023-07-03 · Salman Ul Hassan Dar, Arman Ghanaat, Jannik Kahmann, Isabelle Ayx 외

Generative latent diffusion models have been established as state-of-the-art in data generation. One promising application is generation of realistic synthetic medical imaging data for open data sharing without compromis…

Contrastive LearningImage GenerationMemorization

Quantifying the Ease of Reproducing Training Data in Unconditional Diffusion Models

2025-03-25 · Masaya Hasegawa, Koji Yasuda

Diffusion models, which have been advancing rapidly in recent years, may generate samples that closely resemble the training data. This phenomenon, known as memorization, may lead to copyright issues. In this study, we p…

Memorization

Diffusing the Blind Spot: Uterine MRI Synthesis with Diffusion Models

2025-08-11 · Johanna P. Müller, Anika Knupfer, Pedro Blöss, Edoardo Berardi Vittur 외 arxiv

Despite significant progress in generative modelling, existing diffusion models often struggle to produce anatomically precise female pelvic images, limiting their application in gynaecological imaging, where data scarci…

How Diffusion Models Memorize

2025-09-30 · Juyeop Kim, Songkuk Kim, Jong-Seok Lee arxiv

Despite their success in image generation, diffusion models can memorize training data, raising serious privacy and copyright concerns. Although prior work has sought to characterize, detect, and mitigate memorization, t…

Image Generation

An Inversion-based Measure of Memorization for Diffusion Models

2024-05-09 · Zhe Ma, Qingming Li, Xuhong Zhang, Tianyu Du 외

The past few years have witnessed substantial advances in image generation powered by diffusion models. However, it was shown that diffusion models are vulnerable to training data memorization, raising concerns regarding…

Image GenerationMemorizationPrivacy Preserving