paper-with-me

Papers

High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithm

2019-08-28 · Wenlong Mou, Yi-An Ma, Martin J. Wainwright, Peter L. Bartlett, Michael. I. Jordan

We propose a Markov chain Monte Carlo (MCMC) algorithm based on third-order Langevin dynamics for sampling from distributions with log-concave and smooth densities. The higher-order dynamics allow for more flexible discretization schemes, and we develop a specific method that combines splitting with more accurate integration. For a broad class of $d$-dimensional distributions arising from generalized linear models, we prove that the resulting third-order algorithm produces samples from a distribution that is at most $\varepsilon > 0$ in Wasserstein distance from the target distribution in $O\left(\frac{d^{1/4}}{ \varepsilon^{1/2}} \right)$ steps. This result requires only Lipschitz conditions on the gradient. For general strongly convex potentials with $\alpha$-th order smoothness, we prove that the mixing time scales as $O \left(\frac{d^{1/4}}{\varepsilon^{1/2}} + \frac{d^{1/2}}{\varepsilon^{1/(\alpha - 1)}} \right)$.

📄 PDF Abstract BibTeX arXiv:1908.10859

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Accelerated Bayesian imaging by relaxed proximal-point Langevin sampling

2023-08-18 · Teresa Klatzer, Paul Dobson, Yoann Altmann, Marcelo Pereyra 외

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a …

Bayesian InferenceImage Deconvolution

Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexity

2019-07-25 · Wenlong Mou, Nicolas Flammarion, Martin J. Wainwright, Peter L. Bartlett

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existi…

Exponential ergodicity of mirror-Langevin diffusions

2020-05-19 · NeurIPS 2020 12 · Sinho Chewi, Thibaut Le Gouic, Chen Lu, Tyler Maunu 외

Motivated by the problem of sampling from ill-conditioned log-concave distributions, we give a clean non-asymptotic convergence analysis of mirror-Langevin diffusions as introduced in Zhang et al. (2020). As a special ca…

Accelerated replica exchange stochastic gradient Langevin diffusion enhanced Bayesian DeepONet for solving noisy parametric PDEs

2021-11-03 · Guang Lin, Christian Moya, Zecheng Zhang

The Deep Operator Networks~(DeepONet) is a fundamentally different class of neural networks that we train to approximate nonlinear operators, including the solution operator of parametric partial differential equations (…

Hessian-Free High-Resolution Nesterov Acceleration for Sampling

2020-06-16 · Ruilin Li, Hongyuan Zha, Molei Tao

Nesterov's Accelerated Gradient (NAG) for optimization has better performance than its continuous time limit (noiseless kinetic Langevin) when a finite step-size is employed \citep{shi2021understanding}. This work explor…

Vocal Bursts Intensity Prediction