paper-with-me

홈 › Papers

DMin: Scalable Training Data Influence Estimation for Diffusion Models

2024-12-11 · Huawei Lin, Yingjie Lao, Weijie Zhao

Identifying the training data samples that most influence a generated image is a critical task in understanding diffusion models, yet existing influence estimation methods are constrained to small-scale or LoRA-tuned models due to computational limitations. As diffusion models scale up, these methods become impractical. To address this challenge, we propose DMin (Diffusion Model influence), a scalable framework for estimating the influence of each training data sample on a given generated image. By leveraging efficient gradient compression and retrieval techniques, DMin reduces storage requirements from 339.39 TB to only 726 MB and retrieves the top-k most influential training samples in under 1 second, all while maintaining performance. Our empirical results demonstrate DMin is both effective in identifying influential training samples and efficient in terms of computational and storage requirements.

📄 PDF Abstract BibTeX arXiv:2412.08637

Code (1)

huawei-lin/DMin 공식 구현 pytorch

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Exploring the Long Short-Term Dependencies to Infer Shot Influence in Badminton Matches

2021-09-14 · Wei-Yao Wang, Teng-Fong Chan, Hui-Kuo Yang, Chih-Chuan Wang 외

Identifying significant shots in a rally is important for evaluating players' performance in badminton matches. While there are several studies that have quantified player performance in other sports, analyzing badminton…

Layer-Aware Influence for Online Data Valuation Estimation

2025-10-14 · Ziao Yang, Longbo Huang, Hongfu Liu arxiv

Data-centric learning emphasizes curating high-quality training samples to boost performance rather than designing new architectures. A central problem is to estimate the influence of training sample efficiently. Prior s…

Image Classification

"Is There Anything Else?'': Examining Administrator Influence on Linguistic Features from the Cookie Theft Picture Description Cognitive Test

2025-03-25 · Changye Li, Zhecheng Sheng, Trevor Cohen, Serguei Pakhomov

Alzheimer's Disease (AD) dementia is a progressive neurodegenerative disease that negatively impacts patients' cognitive ability. Previous studies have demonstrated that changes in naturalistic language samples can be us…

Scalable Continuous-time Diffusion Framework for Network Inference and Influence Estimation

2024-03-05 · Keke Huang, Ruize Gao, Bogdan Cautis, Xiaokui Xiao

The study of continuous-time information diffusion has been an important area of research for many applications in recent years. When only the diffusion traces (cascades) are accessible, cascade-based network inference a…

Scalable Influence Estimation Without Sampling

2019-12-29 · Andrey Y. Lokhov, David Saad

In a diffusion process on a network, how many nodes are expected to be influenced by a set of initial spreaders? This natural problem, often referred to as influence estimation, boils down to computing the marginal proba…