paper-with-me

홈 › Papers

Gradient-free Riemannian Langevin Sampler

2026-07-08 · Ricardo Baptista, Olivier Zahm arxiv

We address the problem of efficiently sampling multimodal probability distributions, where standard Markov Chain Monte Carlo methods often suffer from poor mixing and mode trapping. To mitigate these issues, we propose Gradient-free Riemannian Langevin Sampler (GRiLS), a novel proposal that improves exploration without requiring gradient evaluations of the target density. Our approach introduces a Riemannian metric which reshapes the local geometry in order to facilitate transitions across modes. The resulting gradient-free MCMC algorithm is particularly suitable for complex, computationally expensive targets where derivatives are unavailable or impractical. The GRiLS proposal requires knowing the mean and covariance of the target density, which we estimate using an ensemble of interacting particles. Empirical results on multimodal benchmarks demonstrate that GRiLS achieves improved mixing compared to existing gradient-based and gradient-free MCMC approaches.

📄 PDF Abstract BibTeX arXiv:2607.07519

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Optimal Preconditioning and Fisher Adaptive Langevin Sampling

2023-05-23 · NeurIPS 2023 11

We define an optimal preconditioning for the Langevin diffusion by analytically optimizing the expected squared jumped distance. This yields as the optimal preconditioning an inverse Fisher information covariance matrix,…

Position

Interacting Contour Stochastic Gradient Langevin Dynamics

2022-02-20 · ICLR 2022 4 · Wei Deng, Siqi Liang, Botao Hao, Guang Lin 외

We propose an interacting contour stochastic gradient Langevin dynamics (ICSGLD) sampler, an embarrassingly parallel multiple-chain contour stochastic gradient Langevin dynamics (CSGLD) sampler with efficient interaction…

Scalable MCMC for Mixed Membership Stochastic Blockmodels

2015-10-16 · Wenzhe Li, Sungjin Ahn, Max Welling

We propose a stochastic gradient Markov chain Monte Carlo (SG-MCMC) algorithm for scalable inference in mixed-membership stochastic blockmodels (MMSB). Our algorithm is based on the stochastic gradient Riemannian Langevi…

Variational Inference

Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics

2023-03-09 · Hanlin Yu, Marcelo Hartmann, Bernardo Williams, Arto Klami

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better perfo…

Bayesian Inference

Stochastic Gradient Riemannian Langevin Dynamics on the Probability Simplex

2013-12-01 · NeurIPS 2013 12 · Sam Patterson, Yee Whye Teh

In this paper we investigate the use of Langevin Monte Carlo methods on the probability simplex and propose a new method, Stochastic gradient Riemannian Langevin dynamics, which is simple to implement and can be applied …