paper-with-me

Papers

Training Data Attribution for Diffusion Models

2023-06-03 · Zheng Dai, David K Gifford

Diffusion models have become increasingly popular for synthesizing high-quality samples based on training datasets. However, given the oftentimes enormous sizes of the training datasets, it is difficult to assess how training data impact the samples produced by a trained diffusion model. The difficulty of relating diffusion model inputs and outputs poses significant challenges to model explainability and training data attribution. Here we propose a novel solution that reveals how training data influence the output of diffusion models through the use of ensembles. In our approach individual models in an encoded ensemble are trained on carefully engineered splits of the overall training data to permit the identification of influential training examples. The resulting model ensembles enable efficient ablation of training data influence, allowing us to assess the impact of training data on model outputs. We demonstrate the viability of these ensembles as generative models and the validity of our approach to assessing influence.

📄 PDF Abstract BibTeX arXiv:2306.02174

Code (1)

zheng-dai/genens 공식 구현

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

The Journey, Not the Destination: How Data Guides Diffusion Models

2023-12-11 · Kristian Georgiev, Joshua Vendrow, Hadi Salman, Sung Min Park 외

Diffusion models trained on large datasets can synthesize photo-realistic images of remarkable quality and diversity. However, attributing these images back to the training data-that is, identifying specific training exa…

DenoisingDiversity

Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Model

2024-10-24 · Jinxu Lin, Linwei Tao, Minjing Dong, Chang Xu

As diffusion models become increasingly popular, the misuse of copyrighted and private images has emerged as a major concern. One promising solution to mitigate this issue is identifying the contribution of specific trai…

Intriguing Properties of Data Attribution on Diffusion Models

2023-11-01 · Xiaosen Zheng, Tianyu Pang, Chao Du, Jing Jiang 외

Data attribution seeks to trace model outputs back to training data. With the recent development of diffusion models, data attribution has become a desired module to properly assign valuations for high-quality or copyrig…

counterfactual

GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning

2026-01-30 · Naoki Murata, Yuhta Takida, Chieh-Hsin Lai, Toshimitsu Uesaka 외 arxiv

Training-data attribution for vision generative models aims to identify which training data influenced a given output. While most methods score individual examples, practitioners often need group-level answers (e.g., art…

Semantic Similarity

Fast Data Attribution for Text-to-Image Models

2025-11-13 · Sheng-Yu Wang, Aaron Hertzmann, Alexei A Efros, Richard Zhang 외 arxiv

Data attribution for text-to-image models aims to identify the training images that most significantly influenced a generated output. Existing attribution methods involve considerable computational resources for each que…