Dynamic Likelihood-free Inference via Ratio Estimation (DIRE)
Parametric statistical models that are implicitly defined in terms of a stochastic data generating process are used in a wide range of scientific disciplines because they enable accurate modeling. However, learning the parameters from observed data is generally very difficult because their likelihood function is typically intractable. Likelihood-free Bayesian inference methods have been proposed which include the frameworks of approximate Bayesian computation (ABC), synthetic likelihood, and its recent generalization that performs likelihood-free inference by ratio estimation (LFIRE). A major difficulty in all these methods is choosing summary statistics that reduce the dimensionality of the data to facilitate inference. While several methods for choosing summary statistics have been proposed for ABC, the literature for synthetic likelihood and LFIRE is very thin to date. We here address this gap in the literature, focusing on the important special case of time-series models. We show that convolutional neural networks trained to predict the input parameters from the data provide suitable summary statistics for LFIRE. On a wide range of time-series models, a single neural network architecture produced equally or more accurate posteriors than alternative methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Amortised Likelihood-free Inference for Expensive Time-series Simulators with Signatured Ratio Estimation
Simulation models of complex dynamics in the natural and social sciences commonly lack a tractable likelihood function, rendering traditional likelihood-based statistical inference impossible. Recent advances in machine …
Time SeriesTime Series AnalysisAutomatic Posterior Transformation for Likelihood-Free Inference
How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional densit…
Bayesian InferenceTime SeriesTime Series AnalysisNeural Density Estimation and Likelihood-free Inference
I consider two problems in machine learning and statistics: the problem of estimating the joint probability density of a collection of random variables, known as density estimation, and the problem of inferring model par…
BIG-bench Machine LearningDensity EstimationLikelihood-free inference by ratio estimation
We consider the problem of parametric statistical inference when likelihood computations are prohibitively expensive but sampling from the model is possible. Several so-called likelihood-free methods have been developed …
Likelihood-free inference of experimental Neutrino Oscillations using Neural Spline Flows
In machine learning, likelihood-free inference refers to the task of performing an analysis driven by data instead of an analytical expression. We discuss the application of Neural Spline Flows, a neural density estimati…
BIG-bench Machine LearningDensity Estimation