paper-with-me

Papers

Rethinking the Diffusion Model from a Langevin Perspective

2026-04-12 · Candi Zheng, Yuan Lan arxiv

Diffusion models are often introduced from multiple perspectives, such as VAEs, score matching, or flow matching, accompanied by dense and technically demanding mathematics that can be difficult for beginners to grasp. One classic question is: how does the reverse process invert the forward process to generate data from pure noise? This article systematically organizes the diffusion model from a fresh Langevin perspective, offering a simpler, clearer, and more intuitive answer. We also address the following questions: how can ODE-based and SDE-based diffusion models be unified under a single framework? Why are diffusion models theoretically superior to ordinary VAEs? Why is flow matching not fundamentally simpler than denoising or score matching, but equivalent under maximum-likelihood? We demonstrate that the Langevin perspective offers clear and straightforward answers to these questions, bridging existing interpretations of diffusion models, showing how different formulations can be converted into one another within a common framework, and offering pedagogical value for both learners and experienced researchers seeking deeper intuition.

📄 PDF Abstract BibTeX arXiv:2604.10465

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modelling

2025-02-13 · Paula Cordero-Encinar, O. Deniz Akyildiz, Andrew B. Duncan

We investigate the theoretical properties of general diffusion (interpolation) paths and their Langevin Monte Carlo implementation, referred to as diffusion annealed Langevin Monte Carlo (DALMC), under weak conditions on…

Accelerating Nonconvex Learning via Replica Exchange Langevin Diffusion

2020-07-04 · ICLR 2019 5 · Yi Chen, Jinglin Chen, Jing Dong, Jian Peng 외

Langevin diffusion is a powerful method for nonconvex optimization, which enables the escape from local minima by injecting noise into the gradient. In particular, the temperature parameter controlling the noise level gi…

An Improved Analysis of Langevin Algorithms with Prior Diffusion for Non-Log-Concave Sampling

2024-03-10 · Xunpeng Huang, Hanze Dong, Difan Zou, Tong Zhang

Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective. Compared with samplers with unbiased st…

Rethinking Langevin Thompson Sampling from A Stochastic Approximation Perspective

2025-10-06 · Weixin Wang, Haoyang Zheng, Guang Lin, Wei Deng 외 arxiv

Most existing approximate Thompson Sampling (TS) algorithms for multi-armed bandits use Stochastic Gradient Langevin Dynamics (SGLD) or its variants in each round to sample from the posterior, relaxing the need for conju…

Multi-Armed Bandits

Direct Soft-Policy Sampling via Langevin Dynamics

2026-02-08 · Donghyeon Ki, Hee-Jun Ahn, Kyungyoon Kim, Byung-Jun Lee arxiv

Soft policies in reinforcement learning define policies as Boltzmann distributions over state-action value functions, providing a principled mechanism for balancing exploration and exploitation. However, realizing such s…

Reinforcement LearningOpenAI Gym