paper-with-me

홈 › Papers

Improved Bound for Mixing Time of Parallel Tempering

2023-04-03 · Holden Lee, Zeyu Shen

In the field of sampling algorithms, MCMC (Markov Chain Monte Carlo) methods are widely used when direct sampling is not possible. However, multimodality of target distributions often leads to slow convergence and mixing. One common solution is parallel tempering. Though highly effective in practice, theoretical guarantees on its performance are limited. In this paper, we present a new lower bound for parallel tempering on the spectral gap that has a polynomial dependence on all parameters except $\log L$, where $(L + 1)$ is the number of levels. This improves the best existing bound which depends exponentially on the number of modes. Moreover, we complement our result with a hypothetical upper bound on spectral gap that has an exponential dependence on $\log L$, which shows that, in some sense, our bound is tight.

📄 PDF Abstract BibTeX arXiv:2304.01303

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Policy Gradients for Optimal Parallel Tempering MCMC

2024-09-03 · Daniel Zhao, Natesh S. Pillai

Parallel tempering is a meta-algorithm for Markov Chain Monte Carlo that uses multiple chains to sample from tempered versions of the target distribution, enhancing mixing in multi-modal distributions that are challengin…

Polynomial Mixing Times of Simulated Tempering for Mixture Targets by Conductance Decomposition

2025-11-01 · Quan Zhou arxiv

We study the theoretical complexity of simulated tempering for sampling from mixtures of log-concave components differing only by location shifts. The main result establishes the first polynomial-time guarantee for simul…

Diffusive Gibbs Sampling

2024-02-05 · Wenlin Chen, Mingtian Zhang, Brooks Paige, José Miguel Hernández-Lobato 외

The inadequate mixing of conventional Markov Chain Monte Carlo (MCMC) methods for multi-modal distributions presents a significant challenge in practical applications such as Bayesian inference and molecular dynamics. Ad…

Bayesian InferenceDenoising

Multiscale Parallel Tempering for Fast Sampling on Redistricting Plans

2024-01-30 · Gabriel Chuang, Gregory Herschlag, Jonathan C. Mattingly

When auditing a redistricting plan, a persuasive method is to compare the plan with an ensemble of neutrally drawn redistricting plans. Ensembles are generated via algorithms that sample distributions on balanced graph p…

Enhancing Gradient-based Discrete Sampling via Parallel Tempering

2025-02-26 · Luxu Liang, Yuhang Jia, Feng Zhou

While gradient-based discrete samplers are effective in sampling from complex distributions, they are susceptible to getting trapped in local minima, particularly in high-dimensional, multimodal discrete distributions, o…