paper-with-me

Papers

Diffusion Models in Vision: A Survey

2022-09-10 · Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, Mubarak Shah

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. In the forward diffusion stage, the input data is gradually perturbed over several steps by adding Gaussian noise. In the reverse stage, a model is tasked at recovering the original input data by learning to gradually reverse the diffusion process, step by step. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens, i.e. low speeds due to the high number of steps involved during sampling. In this survey, we provide a comprehensive review of articles on denoising diffusion models applied in vision, comprising both theoretical and practical contributions in the field. First, we identify and present three generic diffusion modeling frameworks, which are based on denoising diffusion probabilistic models, noise conditioned score networks, and stochastic differential equations. We further discuss the relations between diffusion models and other deep generative models, including variational auto-encoders, generative adversarial networks, energy-based models, autoregressive models and normalizing flows. Then, we introduce a multi-perspective categorization of diffusion models applied in computer vision. Finally, we illustrate the current limitations of diffusion models and envision some interesting directions for future research.

📄 PDF Abstract BibTeX arXiv:2209.04747

Code (1)

CroitoruAlin/Diffusion-Models-in-Vision-A-Survey tf

Tasks

ArticlesDenoisingSurvey

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Diffusion Models and Representation Learning: A Survey

2024-06-30 · Michael Fuest, Pingchuan Ma, Ming Gui, Johannes S. Fischer 외

Diffusion Models are popular generative modeling methods in various vision tasks, attracting significant attention. They can be considered a unique instance of self-supervised learning methods due to their independence f…

DenoisingRepresentation LearningSelf-Supervised LearningSurvey

Diffusion Models: A Comprehensive Survey of Methods and Applications

2022-09-02 · Ling Yang, Zhilong Zhang, Yang song, Shenda Hong 외

Diffusion models have emerged as a powerful new family of deep generative models with record-breaking performance in many applications, including image synthesis, video generation, and molecule design. In this survey, we…

Image GenerationImage Super-ResolutionSurveyText-to-Image Generation+1

Diffusion Models for Robotic Manipulation: A Survey

2025-04-11 · Rosa Wolf, Yitian Shi, Sheng Liu, Rania Rayyes

Diffusion generative models have demonstrated remarkable success in visual domains such as image and video generation. They have also recently emerged as a promising approach in robotics, especially in robot manipulation…

Data AugmentationImage AugmentationImitation LearningSurvey+2

Diffusion Models in Low-Level Vision: A Survey

2024-06-17 · Chunming He, Yuqi Shen, Chengyu Fang, Fengyang Xiao 외

Deep generative models have garnered significant attention in low-level vision tasks due to their generative capabilities. Among them, diffusion model-based solutions, characterized by a forward diffusion process and a r…

DenoisingSurvey

Diffusion Models in Recommendation Systems: A Survey

2025-01-17 · Ting-Ruen Wei, Yi Fang

Recommender systems remain an essential topic due to its wide application in various domains and the business potential behind them. With the rise of deep learning, common solutions have leveraged neural networks to faci…

Collaborative FilteringRecommendation SystemsSurvey