paper-with-me

Papers

Transport map unadjusted Langevin algorithms: learning and discretizing perturbed samplers

2023-02-14 · Benjamin J. Zhang, Youssef M. Marzouk, Konstantinos Spiliopoulos

Langevin dynamics are widely used in sampling high-dimensional, non-Gaussian distributions whose densities are known up to a normalizing constant. In particular, there is strong interest in unadjusted Langevin algorithms (ULA), which directly discretize Langevin dynamics to estimate expectations over the target distribution. We study the use of transport maps that approximately normalize a target distribution as a way to precondition and accelerate the convergence of Langevin dynamics. We show that in continuous time, when a transport map is applied to Langevin dynamics, the result is a Riemannian manifold Langevin dynamics (RMLD) with metric defined by the transport map. We also show that applying a transport map to an irreversibly-perturbed ULA results in a geometry-informed irreversible perturbation (GiIrr) of the original dynamics. These connections suggest more systematic ways of learning metrics and perturbations, and also yield alternative discretizations of the RMLD described by the map, which we study. Under appropriate conditions, these discretized processes can be endowed with non-asymptotic bounds describing convergence to the target distribution in 2-Wasserstein distance. Illustrative numerical results complement our theoretical claims.

📄 PDF Abstract BibTeX arXiv:2302.07227

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Anchored Langevin Algorithms

2025-09-23 · Mert Gurbuzbalaban, Hoang M. Nguyen, Xicheng Zhang, Lingjiong Zhu arxiv

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high…

Delocalization of bias in unadjusted Hamiltonian Monte Carlo and underdamped Langevin

2026-07-16 · Yifan Chen, Xiaoou Cheng, Jonathan Niles-Weed, Jonathan Weare arxiv

Unadjusted samplers such as unadjusted Hamiltonian Monte Carlo and underdamped Langevin are well-known to be biased. Metropolis--Hastings adjustment has been conventionally incorporated into Hamiltonian Monte Carlo to el…

Analysis of Langevin Monte Carlo via convex optimization

2018-02-26 · Alain Durmus, Szymon Majewski, Błażej Miasojedow

In this paper, we provide new insights on the Unadjusted Langevin Algorithm. We show that this method can be formulated as a first order optimization algorithm of an objective functional defined on the Wasserstein space …

Bayesian Inference

Score-based Metropolis-Hastings for Fractional Langevin Algorithms

2026-01-31 · Ahmed Aloui, Junyi Liao, Ali Hasan, Jose Blanchet 외 arxiv

Sampling from heavy-tailed and multimodal distributions is challenging when neither the target density nor the proposal density can be evaluated, as in $α$-stable Lévy-driven fractional Langevin algorithms. While the tar…

Randomized Runge-Kutta-Nyström Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo

2023-10-11 · Nawaf Bou-Rabee, Tore Selland Kleppe

We introduce $5/2$- and $7/2$-order $L^2$-accurate randomized Runge-Kutta-Nystr\"{o}m methods, tailored for approximating Hamiltonian flows within non-reversible Markov chain Monte Carlo samplers, such as unadjusted Hami…