paper-with-me

Papers

Parallelising MCMC via Random Forests

2019-11-21 · Wu Changye, Christian P. Robert

For Bayesian computation in big data contexts, the divide-and-conquer MCMC concept splits the whole data set into batches, runs MCMC algorithms separately over each batch to produce samples of parameters, and combines them to produce an approximation of the target distribution. In this article, we embed random forests into this framework and use each subposterior/partial-posterior as a proposal distribution to implement importance sampling. Unlike the existing divide-and-conquer MCMC, our methods are based on scaled subposteriors, whose scale factors are not necessarily restricted to being equal to one or to the number of subsets. Through several experiments, we show that our methods work well with models ranging from Gaussian cases to strongly non-Gaussian cases, and include model misspecification.

📄 PDF Abstract BibTeX arXiv:1911.09698

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Diffusion Generative Modelling for Divide-and-Conquer MCMC

2024-06-17 · C. Trojan, P. Fearnhead, C. Nemeth

Divide-and-conquer MCMC is a strategy for parallelising Markov Chain Monte Carlo sampling by running independent samplers on disjoint subsets of a dataset and merging their output. An ongoing challenge in the literature …

Density Estimation

Bayesian learning of forest and tree graphical models

2021-08-31 · Edmund Jones

In Bayesian learning of Gaussian graphical model structure, it is common to restrict attention to certain classes of graphs and approximate the posterior distribution by repeatedly moving from one graph to another, using…

Exploring helical dynamos with machine learning

2019-05-20 · Farrukh Nauman, Joonas Nättilä

We use ensemble machine learning algorithms to study the evolution of magnetic fields in magnetohydrodynamic (MHD) turbulence that is helically forced. We perform direct numerical simulations of helically forced turbulen…

Bayesian InferenceBIG-bench Machine Learningregression

Type-based MCMC for Sampling Tree Fragments from Forests

2014-10-01 · EMNLP 2014 10 · Xiaochang Peng, Daniel Gildea
Machine TranslationVocal Bursts Type PredictionWord Alignment

Large Scale Nonparametric Bayesian Inference: Data Parallelisation in the Indian Buffet Process

2009-12-01 · NeurIPS 2009 12 · Finale Doshi-Velez, Shakir Mohamed, Zoubin Ghahramani, David A. Knowles

Nonparametric Bayesian models provide a framework for flexible probabilistic modelling of complex datasets. Unfortunately, Bayesian inference methods often require high-dimensional averages and can be slow to compute, es…

Bayesian Inference