paper-with-me

홈 › Papers

Likelihood-free MCMC with Amortized Approximate Ratio Estimators

2019-03-10 · ICML 2020 1 · Joeri Hermans, Volodimir Begy, Gilles Louppe

Posterior inference with an intractable likelihood is becoming an increasingly common task in scientific domains which rely on sophisticated computer simulations. Typically, these forward models do not admit tractable densities forcing practitioners to make use of approximations. This work introduces a novel approach to address the intractability of the likelihood and the marginal model. We achieve this by learning a flexible amortized estimator which approximates the likelihood-to-evidence ratio. We demonstrate that the learned ratio estimator can be embedded in MCMC samplers to approximate likelihood-ratios between consecutive states in the Markov chain, allowing us to draw samples from the intractable posterior. Techniques are presented to improve the numerical stability and to measure the quality of an approximation. The accuracy of our approach is demonstrated on a variety of benchmarks against well-established techniques. Scientific applications in physics show its applicability.

📄 PDF Abstract BibTeX arXiv:1903.04057

Code (5)

MaximeVandegar/Papers-in-100-Lines-of-Code/tree/main/Likelihood_free_MCMC_with_Amortized_Approximate_Ratio_Estimators pytorch
bkmi/cnre pytorch
conormdurkan/lfi pytorch
jtamanas/lbi jax
jtamanas/saxbi jax

Similar Papers 제목 키워드 기반

Error-guided likelihood-free MCMC

2020-10-13 · Volodimir Begy, Erich Schikuta

This work presents a novel posterior inference method for models with intractable evidence and likelihood functions. Error-guided likelihood-free MCMC, or EG-LF-MCMC in short, has been developed for scientific applicatio…

Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler

2020-12-29 · Jianwen Xie, Zilong Zheng, Ping Li

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence betwee…

Real-Time Likelihood-Free Inference of Roman Binary Microlensing Events with Amortized Neural Posterior Estimation

2021-02-10 · Keming Zhang, Joshua S. Bloom, B. Scott Gaudi, Francois Lanusse 외

Fast and automated inference of binary-lens, single-source (2L1S) microlensing events with sampling-based Bayesian algorithms (e.g., Markov Chain Monte Carlo; MCMC) is challenged on two fronts: high computational cost of…

JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models

2023-02-17 · Stefan T. Radev, Marvin Schmitt, Valentin Pratz, Umberto Picchini 외

This work proposes ``jointly amortized neural approximation'' (JANA) of intractable likelihood functions and posterior densities arising in Bayesian surrogate modeling and simulation-based inference. We train three compl…

DiagnosticTime SeriesTime Series Analysis

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

2023-05-24 · NeurIPS 2023 11 · Richard Gao, Michael Deistler, Jakob H. Macke

Simulation-based inference (SBI) enables amortized Bayesian inference for simulators with implicit likelihoods. But when we are primarily interested in the quality of predictive simulations, or when the model cannot exac…

Bayesian Inference