paper-with-me

홈 › Papers

Accelerated Parallel Non-conjugate Sampling for Bayesian Non-parametric Models

2017-05-19 · Michael Minyi Zhang, Sinead A. Williamson, Fernando Perez-Cruz

Inference of latent feature models in the Bayesian nonparametric setting is generally difficult, especially in high dimensional settings, because it usually requires proposing features from some prior distribution. In special cases, where the integration is tractable, we can sample new feature assignments according to a predictive likelihood. We present a novel method to accelerate the mixing of latent variable model inference by proposing feature locations based on the data, as opposed to the prior. First, we introduce an accelerated feature proposal mechanism that we show is a valid MCMC algorithm for posterior inference. Next, we propose an approximate inference strategy to perform accelerated inference in parallel. A two-stage algorithm that combines the two approaches provides a computationally attractive method that can quickly reach local convergence to the posterior distribution of our model, while allowing us to exploit parallelization.

📄 PDF Abstract BibTeX arXiv:1705.07178

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inferencevalid

Similar Papers 제목 키워드 기반

Construction of Nonparametric Bayesian Models from Parametric Bayes Equations

2009-12-01 · NeurIPS 2009 12 · Peter Orbanz

We consider the general problem of constructing nonparametric Bayesian models on infinite-dimensional random objects, such as functions, infinite graphs or infinite permutations. The problem has generated much inte…

A Bayesian Perspective on the Maximum Score Problem

2024-10-22 · Christopher D. Walker

This paper presents a Bayesian inference framework for a linear index threshold-crossing binary choice model that satisfies a median independence restriction. The key idea is that the model is observationally equivalent …

Bayesian Inference

A Sufficient Statistics Construction of Bayesian Nonparametric Exponential Family Conjugate Models

2016-01-10 · Robert Finn, Brian Kulis

Conjugate pairs of distributions over infinite dimensional spaces are prominent in statistical learning theory, particularly due to the widespread adoption of Bayesian nonparametric methodologies for a host of models and…

Learning Theory

Embarrassingly Parallel Variational Inference in Nonconjugate Models

2015-10-14 · Willie Neiswanger, Chong Wang, Eric Xing

We develop a parallel variational inference (VI) procedure for use in data-distributed settings, where each machine only has access to a subset of data and runs VI independently, without communicating with other machines…

Variational Inference

Scalable Nonparametric Sampling from Multimodal Posteriors with the Posterior Bootstrap

2019-02-08 · Edwin Fong, Simon Lyddon, Chris Holmes

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poor…

Bayesian Inferenceregression