paper-with-me

Papers

Speeding Up MCMC by Efficient Data Subsampling

2014-04-16 · Matias Quiroz, Robert Kohn, Mattias Villani, Minh-Ngoc Tran

We propose Subsampling MCMC, a Markov Chain Monte Carlo (MCMC) framework where the likelihood function for $n$ observations is estimated from a random subset of $m$ observations. We introduce a highly efficient unbiased estimator of the log-likelihood based on control variates, such that the computing cost is much smaller than that of the full log-likelihood in standard MCMC. The likelihood estimate is bias-corrected and used in two dependent pseudo-marginal algorithms to sample from a perturbed posterior, for which we derive the asymptotic error with respect to $n$ and $m$, respectively. We propose a practical estimator of the error and show that the error is negligible even for a very small $m$ in our applications. We demonstrate that Subsampling MCMC is substantially more efficient than standard MCMC in terms of sampling efficiency for a given computational budget, and that it outperforms other subsampling methods for MCMC proposed in the literature.

📄 PDF Abstract BibTeX arXiv:1404.4178

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Subsampling MCMC - An introduction for the survey statistician

2018-07-23 · Matias Quiroz, Mattias Villani, Robert Kohn, Minh-Ngoc Tran 외

The rapid development of computing power and efficient Markov Chain Monte Carlo (MCMC) simulation algorithms have revolutionized Bayesian statistics, making it a highly practical inference method in applied work. However…

SurveySurvey Sampling

The block-Poisson estimator for optimally tuned exact subsampling MCMC

2016-03-27 · Matias Quiroz, Minh-Ngoc Tran, Mattias Villani, Robert Kohn 외

Speeding up Markov Chain Monte Carlo (MCMC) for datasets with many observations by data subsampling has recently received considerable attention. A pseudo-marginal MCMC method is proposed that estimates the likelihood by…

Improving Sampling Accuracy of Stochastic Gradient MCMC Methods via Non-uniform Subsampling of Gradients

2020-02-20 · Ruilin Li, Xin Wang, Hongyuan Zha, Molei Tao

Many Markov Chain Monte Carlo (MCMC) methods leverage gradient information of the potential function of target distribution to explore sample space efficiently. However, computing gradients can often be computationally e…

Computational Efficiency

Subsampling Error in Stochastic Gradient Langevin Diffusions

2023-05-23 · Kexin Jin, ChenGuang Liu, Jonas Latz

The Stochastic Gradient Langevin Dynamics (SGLD) are popularly used to approximate Bayesian posterior distributions in statistical learning procedures with large-scale data. As opposed to many usual Markov chain Monte Ca…

Stochastic gradient Markov chain Monte Carlo

2019-07-16 · Christopher Nemeth, Paul Fearnhead

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback o…

Bayesian Inference