paper-with-me

홈 › Papers

The Statistical Accuracy of Neural Posterior and Likelihood Estimation

2024-11-18 · David T. Frazier, Ryan Kelly, Christopher Drovandi, David J. Warne

Neural posterior estimation (NPE) and neural likelihood estimation (NLE) are machine learning approaches that provide accurate posterior, and likelihood, approximations in complex modeling scenarios, and in situations where conducting amortized inference is a necessity. While such methods have shown significant promise across a range of diverse scientific applications, the statistical accuracy of these methods is so far unexplored. In this manuscript, we give, for the first time, an in-depth exploration on the statistical behavior of NPE and NLE. We prove that these methods have similar theoretical guarantees to common statistical methods like approximate Bayesian computation (ABC) and Bayesian synthetic likelihood (BSL). While NPE and NLE methods are just as accurate as ABC and BSL, we prove that this accuracy can often be achieved at a vastly reduced computational cost, and will therefore deliver more attractive approximations than ABC and BSL in certain problems. We verify our results theoretically and in several examples from the literature.

📄 PDF Abstract BibTeX arXiv:2411.12068

Code (1)

RyanJafefKelly/npe_convergence 공식 구현 jax

Methods 이 논문이 사용한 방법론

ABC Class of methods in Bayesian Statistics where the posterior distribution is approximated over a rejection scheme on simulations because the likelihood function is…

Similar Papers 제목 키워드 기반

Communication-Efficient Distributed Statistical Inference

2016-05-25 · Michael. I. Jordan, Jason D. Lee, Yun Yang

We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used…

Bayesian InferenceComputational Efficiency

Towards Unifying Logical Entailment and Statistical Estimation

2022-02-27 · Hiroyuki Kido

This paper gives a generative model of the interpretation of formal logic for data-driven logical reasoning. The key idea is to represent the interpretation as likelihood of a formula being true given a model of formal l…

Formal LogicLogical Reasoning

Preconditioned Neural Posterior Estimation for Likelihood-free Inference

2024-04-21 · Xiaoyu Wang, Ryan P. Kelly, David J. Warne, Christopher Drovandi

Simulation based inference (SBI) methods enable the estimation of posterior distributions when the likelihood function is intractable, but where model simulation is feasible. Popular neural approaches to SBI are the neur…

Adversarial Likelihood-Free Inference on Black-Box Generator

2020-04-13 · Dongjun Kim, Weonyoung Joo, Seungjae Shin, Kyungwoo Song 외

Generative Adversarial Network (GAN) can be viewed as an implicit estimator of a data distribution, and this perspective motivates using the adversarial concept in the true input parameter estimation of black-box generat…

Generative Adversarial Networkparameter estimation

Fast ε-free Inference of Simulation Models with Bayesian Conditional Density Estimation

2016-12-01 · NeurIPS 2016 12 · George Papamakarios, Iain Murray

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods appro…

Density Estimation