Scalable Variational Inference for Dynamical Systems
Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical integration. However, for many real-world applications, only sparse observations are available or even unobserved variables are included in the model description. In these cases most gradient matching methods are difficult to apply or simply do not provide satisfactory results. That is why, despite the high computational cost, numerical integration is still the gold standard in many applications. Using an existing gradient matching approach, we propose a scalable variational inference framework which can infer states and parameters simultaneously, offers computational speedups, improved accuracy and works well even under model misspecifications in a partially observable system.
Code (1)
Tasks
Numerical IntegrationVariational InferenceSimilar Papers 제목 키워드 기반
Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems
Gaussian process state-space models (GPSSMs) offer a principled framework for learning and inference in nonlinear dynamical systems with uncertainty quantification. However, existing GPSSMs are limited by the use of mult…
Computational EfficiencyGaussian ProcessesState EstimationState Space Models+3A Scalable Inference Method For Large Dynamic Economic Systems
The nature of available economic data has changed fundamentally in the last decade due to the economy's digitisation. With the prevalence of often black box data-driven machine learning methods, there is a necessity to d…
Bayesian InferenceBIG-bench Machine LearningInterpretable Machine LearningAn information field theory approach to Bayesian state and parameter estimation in dynamical systems
Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncerta…
parameter estimationState EstimationVariational InferenceNon-Factorised Variational Inference in Dynamical Systems
We focus on variational inference in dynamical systems where the discrete time transition function (or evolution rule) is modelled by a Gaussian process. The dominant approach so far has been to use a factorised posterio…
Variational InferenceEfficient Amortised Bayesian Inference for Hierarchical and Nonlinear Dynamical Systems
We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a …
Bayesian InferenceZero-Shot Learning