paper-with-me

Papers

Fast Parallel SAME Gibbs Sampling on General Discrete Bayesian Networks

2015-11-19 · Daniel Seita, Haoyu Chen, John Canny

A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most accurate approaches and provides unbiased samples from the posterior but it has historically been too expensive for large models. In this paper, we present an optimized, parallel Gibbs sampler augmented with state replication (SAME or State Augmented Marginal Estimation) to decrease convergence time. We find that SAME can improve the quality of parameter estimates while accelerating convergence. Experiments on both synthetic and real data show that our Gibbs sampler is substantially faster than the state of the art sampler, JAGS, without sacrificing accuracy. Our ultimate objective is to introduce the Gibbs sampler to researchers in many fields to expand their range of feasible inference problems.

📄 PDF Abstract BibTeX arXiv:1511.06416

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SAME but Different: Fast and High-Quality Gibbs Parameter Estimation

2014-09-18 · Huasha Zhao, Biye Jiang, John Canny

Gibbs sampling is a workhorse for Bayesian inference but has several limitations when used for parameter estimation, and is often much slower than non-sampling inference methods. SAME (State Augmentation for Marginal Est…

Bayesian Inferenceparameter estimationVocal Bursts Intensity Prediction

Analyzing Hogwild Parallel Gaussian Gibbs Sampling

2013-12-01 · NeurIPS 2013 12 · Matthew Johnson, James Saunderson, Alan Willsky

Sampling inference methods are computationally difficult to scale for many models in part because global dependencies can reduce opportunities for parallel computation. Without strict conditional independence structure …

Perturb-and-max-product: Sampling and learning in discrete energy-based models

2021-11-03 · NeurIPS 2021 12 · Miguel Lazaro-Gredilla, Antoine Dedieu, Dileep George

Perturb-and-MAP offers an elegant approach to approximately sample from a energy-based model (EBM) by computing the maximum-a-posteriori (MAP) configuration of a perturbed version of the model. Sampling in turn enables l…

Local Expectation Gradients for Black Box Variational Inference

2015-12-01 · NeurIPS 2015 12 · Michalis Titsias Rc Aueb, Miguel Lázaro-Gredilla

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients by sampling from the variational distribution. This algorithm divides t…

Variational Inference

Local Expectation Gradients for Doubly Stochastic Variational Inference

2015-03-04 · Michalis K. Titsias

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divi…

Variational Inference