paper-with-me

홈 › Papers

Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributions

2023-06-18 · NeurIPS 2023 11 · Xiang Cheng, Bohan Wang, Jingzhao Zhang, Yusong Zhu

MCMC algorithms offer empirically efficient tools for sampling from a target distribution $\pi(x) \propto \exp(-V(x))$. However, on the theory side, MCMC algorithms suffer from slow mixing rate when $\pi(x)$ is non-log-concave. Our work examines this gap and shows that when Poincar\'e-style inequality holds on a subset $\mathcal{X}$ of the state space, the conditional distribution of MCMC iterates over $\mathcal{X}$ mixes fast to the true conditional distribution. This fast mixing guarantee can hold in cases when global mixing is provably slow. We formalize the statement and quantify the conditional mixing rate. We further show that conditional mixing can have interesting implications for sampling from mixtures of Gaussians, parameter estimation for Gaussian mixture models and Gibbs-sampling with well-connected local minima.

📄 PDF Abstract BibTeX arXiv:2306.10506

Code (0)

등록된 구현이 없습니다.

Tasks

parameter estimation

Similar Papers 제목 키워드 기반

Sampling for Bayesian Mixture Models: MCMC with Polynomial-Time Mixing

2019-12-11 · Wenlong Mou, Nhat Ho, Martin J. Wainwright, Peter L. Bartlett 외

We study the problem of sampling from the power posterior distribution in Bayesian Gaussian mixture models, a robust version of the classical posterior. This power posterior is known to be non-log-concave and multi-modal…

Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Sampling

2021-09-27 · Keru Wu, Scott Schmidler, Yuansi Chen

We study the mixing time of the Metropolis-adjusted Langevin algorithm (MALA) for sampling from a log-smooth and strongly log-concave distribution. We establish its optimal minimax mixing time under a warm start. Our mai…

MCMC assisted by Belief Propagation

2016-05-29 · Sungsoo Ahn, Michael Chertkov, Jinwoo Shin

Markov Chain Monte Carlo (MCMC) and Belief Propagation (BP) are the most popular algorithms for computational inference in Graphical Models (GM). In principle, MCMC is an exact probabilistic method which, however, often …

High-Order Langevin Monte Carlo Algorithms

2025-08-24 · Thanh Dang, Mert Gurbuzbalaban, Mohammad Rafiqul Islam, Nian Yao 외 arxiv

Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order L…

Finite Sample Complexity of Sequential Monte Carlo Estimators on Multimodal Target Distributions

2022-08-13 · Joseph Mathews, Scott C. Schmidler

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is m…