paper-with-me

Papers

Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models

2022-10-10 · Louis Sharrock, Jack Simons, Song Liu, Mark Beaumont

We introduce Sequential Neural Posterior Score Estimation (SNPSE), a score-based method for Bayesian inference in simulator-based models. Our method, inspired by the remarkable success of score-based methods in generative modelling, leverages conditional score-based diffusion models to generate samples from the posterior distribution of interest. The model is trained using an objective function which directly estimates the score of the posterior. We embed the model into a sequential training procedure, which guides simulations using the current approximation of the posterior at the observation of interest, thereby reducing the simulation cost. We also introduce several alternative sequential approaches, and discuss their relative merits. We then validate our method, as well as its amortised, non-sequential, variant on several numerical examples, demonstrating comparable or superior performance to existing state-of-the-art methods such as Sequential Neural Posterior Estimation (SNPE).

📄 PDF Abstract BibTeX arXiv:2210.04872

Code (1)

jacksimons15327/snpse_icml 공식 구현 jax

Tasks

Bayesian Inference

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Automatic Posterior Transformation for Likelihood-Free Inference

2019-05-17 · David S. Greenberg, Marcel Nonnenmacher, Jakob H. Macke

How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional densit…

Bayesian InferenceTime SeriesTime Series Analysis

Confidence Estimation via Sequential Likelihood Mixing

2025-02-20 · Johannes Kirschner, Andreas Krause, Michele Meziu, Mojmir Mutny

We present a universal framework for constructing confidence sets based on sequential likelihood mixing. Building upon classical results from sequential analysis, we provide a unifying perspective on several recent lines…

Bayesian InferenceVariational Inference

Amortised Likelihood-free Inference for Expensive Time-series Simulators with Signatured Ratio Estimation

2022-02-23 · Joel Dyer, Patrick Cannon, Sebastian M Schmon

Simulation models of complex dynamics in the natural and social sciences commonly lack a tractable likelihood function, rendering traditional likelihood-based statistical inference impossible. Recent advances in machine …

Time SeriesTime Series Analysis

Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows

2018-05-18 · George Papamakarios, David C. Sterratt, Iain Murray

We present Sequential Neural Likelihood (SNL), a new method for Bayesian inference in simulator models, where the likelihood is intractable but simulating data from the model is possible. SNL trains an autoregressive flo…

Bayesian Inference

A transport approach to sequential simulation-based inference

2023-08-26 · Paul-Baptiste Rubio, Youssef Marzouk, Matthew Parno

We present a new transport-based approach to efficiently perform sequential Bayesian inference of static model parameters. The strategy is based on the extraction of conditional distribution from the joint distribution o…

Bayesian Inferenceparameter estimationSequential Bayesian Inference