paper-with-me

Papers

ProtoDiffusion: Classifier-Free Diffusion Guidance with Prototype Learning

2023-07-04 · Gulcin Baykal, Halil Faruk Karagoz, Taha Binhuraib, Gozde Unal

Diffusion models are generative models that have shown significant advantages compared to other generative models in terms of higher generation quality and more stable training. However, the computational need for training diffusion models is considerably increased. In this work, we incorporate prototype learning into diffusion models to achieve high generation quality faster than the original diffusion model. Instead of randomly initialized class embeddings, we use separately learned class prototypes as the conditioning information to guide the diffusion process. We observe that our method, called ProtoDiffusion, achieves better performance in the early stages of training compared to the baseline method, signifying that using the learned prototypes shortens the training time. We demonstrate the performance of ProtoDiffusion using various datasets and experimental settings, achieving the best performance in shorter times across all settings.

📄 PDF Abstract BibTeX arXiv:2307.01924

Code (1)

ituvisionlab/ProtoDiffusion 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Studying Classifier(-Free) Guidance From a Classifier-Centric Perspective

2025-03-13 · Xiaoming Zhao, Alexander G. Schwing

Classifier-free guidance has become a staple for conditional generation with denoising diffusion models. However, a comprehensive understanding of classifier-free guidance is still missing. In this work, we carry out an …

Denoising

Prototype Clustered Diffusion Models for Versatile Inverse Problems

2024-07-13 · Jinghao Zhang, Zizheng Yang, Qi Zhu, Feng Zhao

Diffusion models have made remarkable progress in solving various inverse problems, attributing to the generative modeling capability of the data manifold. Posterior sampling from the conditional score function enable th…

DeblurringImage Dehazing

Classifier-Free Diffusion Guidance

2022-07-26 · Jonathan Ho, Tim Salimans

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other type…

Diversity

C$^2$FG: Control Classifier-Free Guidance via Score Discrepancy Analysis

2026-03-09 · Jiayang Gao, Tianyi Zheng, Jiayang Zou, Fengxiang Yang 외 arxiv

Classifier-Free Guidance (CFG) is a cornerstone of modern conditional diffusion models, yet its reliance on the fixed or heuristic dynamic guidance weight is predominantly empirical and overlooks the inherent dynamics of…

Incorporating Classifier-Free Guidance in Diffusion Model-Based Recommendation

2024-09-16 · Noah Buchanan, Susan Gauch, Quan Mai

This paper presents a diffusion-based recommender system that incorporates classifier-free guidance. Most current recommender systems provide recommendations using conventional methods such as collaborative or content-ba…

Recommendation Systems