paper-with-me

홈 › Papers

Error-guided likelihood-free MCMC

2020-10-13 · Volodimir Begy, Erich Schikuta

This work presents a novel posterior inference method for models with intractable evidence and likelihood functions. Error-guided likelihood-free MCMC, or EG-LF-MCMC in short, has been developed for scientific applications, where a researcher is interested in obtaining approximate posterior densities over model parameters, while avoiding the need for expensive training of component estimators on full observational data or the tedious design of expressive summary statistics, as in related approaches. Our technique is based on two phases. In the first phase, we draw samples from the prior, simulate respective observations and record their errors $\epsilon$ in relation to the true observation. We train a classifier to distinguish between corresponding and non-corresponding $(\epsilon, \boldsymbol{\theta})$-tuples. In the second stage the said classifier is conditioned on the smallest recorded $\epsilon$ value from the training set and employed for the calculation of transition probabilities in a Markov Chain Monte Carlo sampling procedure. By conditioning the MCMC on specific $\epsilon$ values, our method may also be used in an amortized fashion to infer posterior densities for observations, which are located a given distance away from the observed data. We evaluate the proposed method on benchmark problems with semantically and structurally different data and compare its performance against the state of the art approximate Bayesian computation (ABC).

📄 PDF Abstract BibTeX arXiv:2010.06735

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Speeding Up MCMC by Efficient Data Subsampling

2014-04-16 · Matias Quiroz, Robert Kohn, Mattias Villani, Minh-Ngoc Tran

We propose Subsampling MCMC, a Markov Chain Monte Carlo (MCMC) framework where the likelihood function for $n$ observations is estimated from a random subset of $m$ observations. We introduce a highly efficient unbiased …

Adaptive Physics-Informed Neural Networks for Markov-Chain Monte Carlo

2020-08-03 · Mohammad Amin Nabian, Hadi Meidani

In this paper, we propose the Adaptive Physics-Informed Neural Networks (APINNs) for accurate and efficient simulation-free Bayesian parameter estimation via Markov-Chain Monte Carlo (MCMC). We specifically focus on a cl…

parameter estimation

Likelihood Inflating Sampling Algorithm

2016-05-06 · Reihaneh Entezari, Radu V. Craiu, Jeffrey S. Rosenthal

Markov Chain Monte Carlo (MCMC) sampling from a posterior distribution corresponding to a massive data set can be computationally prohibitive since producing one sample requires a number of operations that is linear in t…

Likelihood-free MCMC with Amortized Approximate Ratio Estimators

2019-03-10 · ICML 2020 1 · Joeri Hermans, Volodimir Begy, Gilles Louppe

Posterior inference with an intractable likelihood is becoming an increasingly common task in scientific domains which rely on sophisticated computer simulations. Typically, these forward models do not admit tractable de…

Firefly Monte Carlo: Exact MCMC with Subsets of Data

2014-03-22 · Dougal Maclaurin, Ryan P. Adams

Markov chain Monte Carlo (MCMC) is a popular and successful general-purpose tool for Bayesian inference. However, MCMC cannot be practically applied to large data sets because of the prohibitive cost of evaluating every …

Bayesian Inference