paper-with-me

홈 › Papers

Recursive Gaussian Process State Space Model

2024-11-22 · Tengjie Zheng, Haipeng Chen, Lin Cheng, Shengping Gong, Xu Huang

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models (GPSSMs) have recently gained significant attention due to their combination of flexibility and interpretability. However, for online learning, the field lacks an efficient method suitable for scenarios where prior information regarding data distribution and model function is limited. To address this issue, this paper proposes a recursive GPSSM method with adaptive capabilities for both operating domains and Gaussian process (GP) hyperparameters. Specifically, we first utilize first-order linearization to derive a Bayesian update equation for the joint distribution between the system state and the GP model, enabling closed-form and domain-independent learning. Second, an online selection algorithm for inducing points is developed based on informative criteria to achieve lightweight learning. Third, to support online hyperparameter optimization, we recover historical measurement information from the current filtering distribution. Comprehensive evaluations on both synthetic and real-world datasets demonstrate the superior accuracy, computational efficiency, and adaptability of our method compared to state-of-the-art online GPSSM techniques.

📄 PDF Abstract BibTeX arXiv:2411.14679

Code (2)

TengjieZheng/rgpssm 공식 구현 pytorch
zhidilin/gpssmproj 공식 구현 pytorch

Tasks

Computational EfficiencyHyperparameter OptimizationmodelState Space ModelsTime Series Prediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Numerical Gaussian process Kalman filtering for spatiotemporal systems

2021-05-05 · Armin Küper, Steffen Waldherr

We present a novel Kalman filter for spatiotemporal systems called the numerical Gaussian process Kalman filter (GPKF). Numerical Gaussian processes have recently been introduced as a physics informed machine learning me…

BIG-bench Machine LearningGaussian ProcessesPhysics-informed machine learning

Learning Driver Behaviors Using A Gaussian Process Augmented State-Space Model

2020-03-16

An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performanc…

PositionState Space Models

Statistics on the (compact) Stiefel manifold: Theory and Applications

2017-07-31 · Rudrasis Chakraborty, Baba Vemuri

A Stiefel manifold of the compact type is often encountered in many fields of Engineering including, signal and image processing, machine learning, numerical optimization and others. The Stiefel manifold is a Riemannian …

A Marginalized Particle Gaussian Process Regression

2012-12-01 · NeurIPS 2012 12 · Yali Wang, Brahim Chaib-Draa

We present a novel marginalized particle Gaussian process (MPGP) regression, which provides a fast, accurate online Bayesian filtering framework to model the latent function. Using a state space model established by the …

Computational Efficiencyregression

Recursive Entropic Variational Inference for Nonlinear State-Space Models

2025-11-19 · Hany Abdulsamad, Ángel F. García-Fernández, Simo Särkkä arxiv

We present a class of algorithms for state estimation in nonlinear, non-Gaussian state-space models. Our approach is based on a variational Lagrangian formulation that casts Bayesian inference as a sequence of entropic t…

Bayesian Inference