paper-with-me

Papers

Data-driven Modeling and Inference for Bayesian Gaussian Process ODEs via Double Normalizing Flows

2023-09-17 · Jian Xu, Shian Du, Junmei Yang, Xinghao Ding, John Paisley, Delu Zeng

Recently, Gaussian processes have been used to model the vector field of continuous dynamical systems, referred to as GPODEs, which are characterized by a probabilistic ODE equation. Bayesian inference for these models has been extensively studied and applied in tasks such as time series prediction. However, the use of standard GPs with basic kernels like squared exponential kernels has been common in GPODE research, limiting the model's ability to represent complex scenarios. To address this limitation, we introduce normalizing flows to reparameterize the ODE vector field, resulting in a data-driven prior distribution, thereby increasing flexibility and expressive power. We develop a data-driven variational learning algorithm that utilizes analytically tractable probability density functions of normalizing flows, enabling simultaneous learning and inference of unknown continuous dynamics. Additionally, we also apply normalizing flows to the posterior inference of GP ODEs to resolve the issue of strong mean-field assumptions in posterior inference. By applying normalizing flows in both these ways, our model improves accuracy and uncertainty estimates for Bayesian Gaussian Process ODEs. We validate the effectiveness of our approach on simulated dynamical systems and real-world human motion data, including time series prediction and missing data recovery tasks. Experimental results show that our proposed method effectively captures model uncertainty while improving accuracy.

📄 PDF Abstract BibTeX arXiv:2309.09222

Code (1)

xujianscut/GPODE-DNF pytorch

Tasks

Bayesian InferenceGaussian ProcessesTime SeriesTime Series Prediction

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Fully Bayesian inference for latent variable Gaussian process models

2022-11-04 · Suraj Yerramilli, Akshay Iyer, Wei Chen, Daniel W. Apley

Real engineering and scientific applications often involve one or more qualitative inputs. Standard Gaussian processes (GPs), however, cannot directly accommodate qualitative inputs. The recently introduced latent variab…

Bayesian InferenceGaussian ProcessesUncertainty Quantification

A2 Copula-Driven Spatial Bayesian Neural Network For Modeling Non-Gaussian Dependence: A Simulation Study

2025-05-29 · Agnideep Aich, Sameera Hewage, Md Monzur Murshed, Ashit Baran Aich 외

In this paper, we introduce the A2 Copula Spatial Bayesian Neural Network (A2-SBNN), a predictive spatial model designed to map coordinates to continuous fields while capturing both typical spatial patterns and extreme d…

Structured Bayesian Gaussian process latent variable model

2018-05-22 · Steven Atkinson, Nicholas Zabaras

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covarianc…

ImputationmodelSuper-ResolutionTime Series+1

Pseudo-Marginal Bayesian Inference for Gaussian Processes

2013-10-02 · Maurizio Filippone, Mark Girolami

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based …

Bayesian InferenceGaussian Processes

Bayesian Non-linear Latent Variable Modeling via Random Fourier Features

2023-06-14 · Michael Minyi Zhang, Gregory W. Gundersen, Barbara E. Engelhardt

The Gaussian process latent variable model (GPLVM) is a popular probabilistic method used for nonlinear dimension reduction, matrix factorization, and state-space modeling. Inference for GPLVMs is computationally tractab…

Dimensionality Reduction