paper-with-me

Papers

Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

2021-03-04 · Mohamed Aziz Bhouri, Paris Perdikaris

This paper presents a machine learning framework (GP-NODE) for Bayesian systems identification from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. Moreover, the use of sparsity-promoting priors such as the Finnish Horseshoe for free model parameters enables the discovery of interpretable and parsimonious representations for the underlying latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator-prey systems, systems biology, and a 50-dimensional human motion dynamical system. Taken together, our findings put forth a novel, flexible and robust workflow for data-driven model discovery under uncertainty. All code and data accompanying this manuscript are available online at \url{https://github.com/PredictiveIntelligenceLab/GP-NODEs}.

📄 PDF Abstract BibTeX arXiv:2103.03385

Code (1)

PredictiveIntelligenceLab/GP-NODEs 공식 구현 jax

Tasks

Bayesian InferenceGaussian ProcessesModel Discovery

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Tensor Regression Meets Gaussian Processes

2017-10-31 · Rose Yu, Guangyu Li, Yan Liu

Low-rank tensor regression, a new model class that learns high-order correlation from data, has recently received considerable attention. At the same time, Gaussian processes (GP) are well-studied machine learning models…

Bayesian InferenceGaussian Processesregression

Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learning

2022-05-12 · Veit D. Wild, Robert Hu, Dino Sejdinovic

We develop a framework for generalized variational inference in infinite-dimensional function spaces and use it to construct a method termed Gaussian Wasserstein inference (GWI). GWI leverages the Wasserstein distance be…

Gaussian ProcessesUncertainty QuantificationVariational Inference

A Bayesian estimation approach to analyze non-Gaussian data-generating processes with latent classes

2014-08-02 · Naoki Tanaka, Shohei Shimizu, Takashi Washio

A large amount of observational data has been accumulated in various fields in recent times, and there is a growing need to estimate the generating processes of these data. A linear non-Gaussian acyclic model (LiNGAM) ba…

Bayesian Optimization using Deep Gaussian Processes

2019-05-07 · Ali Hebbal, Loic Brevault, Mathieu Balesdent, El-Ghazali Talbi 외

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classi…

Bayesian OptimizationGaussian Processesglobal-optimization

Provable and scalable quantum Gaussian processes for quantum learning

2026-04-30 · Jonas Jäger, Paolo Braccia, Pablo Bermejo, Manuel G. Algaba 외 arxiv

Despite rapid recent advances in quantum machine learning, the field is in many ways stuck. Existing approaches can exhibit serious limitations, and we still lack learning frameworks that are simple, interpretable, scala…

Quantum Machine LearningGaussian Processes