paper-with-me

홈 › Papers

Deep Learning Aided Laplace Based Bayesian Inference for Epidemiological Systems

2022-10-17 · Wai Meng Kwok, Sarat Chandra Dass, George Streftaris

Parameter estimation and associated uncertainty quantification is an important problem in dynamical systems characterized by ordinary differential equation (ODE) models that are often nonlinear. Typically, such models have analytically intractable trajectories which result in likelihoods and posterior distributions that are similarly intractable. Bayesian inference for ODE systems via simulation methods require numerical approximations to produce inference with high accuracy at a cost of heavy computational power and slow convergence. At the same time, Artificial Neural Networks (ANN) offer tractability that can be utilized to construct an approximate but tractable likelihood and posterior distribution. In this paper we propose a hybrid approach, where Laplace-based Bayesian inference is combined with an ANN architecture for obtaining approximations to the ODE trajectories as a function of the unknown initial values and system parameters. Suitable choices of a collocation grid and customized loss functions are proposed to fine tune the ODE trajectories and Laplace approximation. The effectiveness of our proposed methods is demonstrated using an epidemiological system with non-analytical solutions, the Susceptible-Infectious-Removed (SIR) model for infectious diseases, based on simulated and real-life influenza datasets. The novelty and attractiveness of our proposed approach include (i) a new development of Bayesian inference using ANN architectures for ODE based dynamical systems, and (ii) a computationally fast posterior inference by avoiding convergence issues of benchmark Markov Chain Monte Carlo methods. These two features establish the developed approach as an accurate alternative to traditional Bayesian computational methods, with improved computational cost.

📄 PDF Abstract BibTeX arXiv:2210.08865

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceDeep Learningparameter estimationUncertainty Quantification

Similar Papers 제목 키워드 기반

Bayesian Deep Learning via Subnetwork Inference

2020-10-28 · Erik Daxberger, Eric Nalisnick, James Urquhart Allingham, Javier Antorán 외

The Bayesian paradigm has the potential to solve core issues of deep neural networks such as poor calibration and data inefficiency. Alas, scaling Bayesian inference to large weight spaces often requires restrictive appr…

Bayesian InferenceDeep Learning

Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC

2026-06-25 · Alina Bazarova, Johann Fredrik Jadebeck, Henrik Zunker, Carolina J. Klett-Tammen 외 arxiv

Mechanistic epidemiological models are widely used to support infectious disease forecasting and public-health decision making. Bayesian calibration of such models is commonly performed using Markov chain Monte Carlo (MC…

Decision Making

Disentangling the Gauss-Newton Method and Approximate Inference for Neural Networks

2020-07-21 · Alexander Immer

In this thesis, we disentangle the generalized Gauss-Newton and approximate inference for Bayesian deep learning. The generalized Gauss-Newton method is an optimization method that is used in several popular Bayesian dee…

Deep LearningGaussian Processes

Variational Laplace for Bayesian neural networks

2020-11-20 · Ali Unlu, Laurence Aitchison

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-netwo…

BenchmarkingVariational Inference

Variational Laplace for Bayesian neural networks

2021-02-27 · Ali Unlu, Laurence Aitchison

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-netwo…

BenchmarkingImage ClassificationVariational Inference