paper-with-me

Papers

Sample-efficient neural likelihood-free Bayesian inference of implicit HMMs

2024-05-02 · Sanmitra Ghosh, Paul J. Birrell, Daniela De Angelis

Likelihood-free inference methods based on neural conditional density estimation were shown to drastically reduce the simulation burden in comparison to classical methods such as ABC. When applied in the context of any latent variable model, such as a Hidden Markov model (HMM), these methods are designed to only estimate the parameters, rather than the joint distribution of the parameters and the hidden states. Naive application of these methods to a HMM, ignoring the inference of this joint posterior distribution, will thus produce an inaccurate estimate of the posterior predictive distribution, in turn hampering the assessment of goodness-of-fit. To rectify this problem, we propose a novel, sample-efficient likelihood-free method for estimating the high-dimensional hidden states of an implicit HMM. Our approach relies on learning directly the intractable posterior distribution of the hidden states, using an autoregressive-flow, by exploiting the Markov property. Upon evaluating our approach on some implicit HMMs, we found that the quality of the estimates retrieved using our method is comparable to what can be achieved using a much more computationally expensive SMC algorithm.

📄 PDF Abstract BibTeX arXiv:2405.01737

Code (1)

sg5g10/hmm 공식 구현 pytorch

Tasks

Bayesian InferenceDensity Estimation

Methods 이 논문이 사용한 방법론

ABC Class of methods in Bayesian Statistics where the posterior distribution is approximated over a rejection scheme on simulations because the likelihood function is…

Similar Papers 제목 키워드 기반

Mining gold from implicit models to improve likelihood-free inference

2018-05-30 · Johann Brehmer, Gilles Louppe, Juan Pavez, Kyle Cranmer

Simulators often provide the best description of real-world phenomena. However, they also lead to challenging inverse problems because the density they implicitly define is often intractable. We present a new suite of si…

Hierarchical Implicit Models and Likelihood-Free Variational Inference

2017-02-28 · NeurIPS 2017 12 · Dustin Tran, Rajesh Ranganath, David M. Blei

Implicit probabilistic models are a flexible class of models defined by a simulation process for data. They form the basis for theories which encompass our understanding of the physical world. Despite this fundamental na…

Generative Adversarial NetworkText GenerationVariational Inference

Predictive variational inference: Learn the predictively optimal posterior distribution

2024-10-18 · Jinlin Lai, Yuling Yao

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive varia…

Variational Inference

Adversarial Bayesian Simulation

2022-08-25 · Yuexi Wang, Veronika Ročková

In the absence of explicit or tractable likelihoods, Bayesians often resort to approximate Bayesian computation (ABC) for inference. Our work bridges ABC with deep neural implicit samplers based on generative adversarial…

Wasserstein Gaussianization and Efficient Variational Bayes for Robust Bayesian Synthetic Likelihood

2023-05-24 · Nhat-Minh Nguyen, Minh-Ngoc Tran, Christopher Drovandi, David Nott

The Bayesian Synthetic Likelihood (BSL) method is a widely-used tool for likelihood-free Bayesian inference. This method assumes that some summary statistics are normally distributed, which can be incorrect in many appli…

Bayesian Inference