paper-with-me

홈 › Papers

Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev

2021-12-23 · Sinho Chewi, Murat A. Erdogdu, Mufan Bill Li, Ruoqi Shen, Matthew Zhang

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution $\pi$ under the sole assumption that $\pi$ satisfies a Poincar\'e inequality. Using this fact to provide guarantees for the discrete-time Langevin Monte Carlo (LMC) algorithm, however, is considerably more challenging due to the need for working with chi-squared or R\'enyi divergences, and prior works have largely focused on strongly log-concave targets. In this work, we provide the first convergence guarantees for LMC assuming that $\pi$ satisfies either a Lata\l{}a--Oleszkiewicz or modified log-Sobolev inequality, which interpolates between the Poincar\'e and log-Sobolev settings. Unlike prior works, our results allow for weak smoothness and do not require convexity or dissipativity conditions.

📄 PDF Abstract BibTeX arXiv:2112.12662

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincaré Inequality

2023-03-07 · Alireza Mousavi-Hosseini, Tyler Farghly, Ye He, Krishnakumar Balasubramanian 외

Langevin diffusions are rapidly convergent under appropriate functional inequality assumptions. Hence, it is natural to expect that with additional smoothness conditions to handle the discretization errors, their discret…

Improved Discretization Analysis for Underdamped Langevin Monte Carlo

2023-02-16 · Matthew Zhang, Sinho Chewi, Mufan Bill Li, Krishnakumar Balasubramanian 외

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by tw…

Non-asymptotic analysis of Langevin-type Monte Carlo algorithms

2023-03-22 · Shogo Nakakita

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main resu…

Vocal Bursts Type Prediction

Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data

2025-03-13 · Dibyakanti Kumar, Samyak Jha, Anirbit Mukherjee

In this work, we will establish that the Langevin Monte-Carlo algorithm can learn depth-2 neural nets of any size and for any data and we give non-asymptotic convergence rates for it. We achieve this via showing that und…

Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlo

2022-02-10 · Krishnakumar Balasubramanian, Sinho Chewi, Murat A. Erdogdu, Adil Salim 외

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilo…