Recursive Gaussian Process State Space Model
Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models (GPSSMs) have recently gained significant attention due to their combination of flexibility and interpretability. However, for online learning, the field lacks an efficient method suitable for scenarios where prior information regarding data distribution and model function is limited. To address this issue, this paper proposes a recursive GPSSM method with adaptive capabilities for both operating domains and Gaussian process (GP) hyperparameters. Specifically, we first utilize first-order linearization to derive a Bayesian update equation for the joint distribution between the system state and the GP model, enabling closed-form and domain-independent learning. Second, an online selection algorithm for inducing points is developed based on informative criteria to achieve lightweight learning. Third, to support online hyperparameter optimization, we recover historical measurement information from the current filtering distribution. Comprehensive evaluations on both synthetic and real-world datasets demonstrate the superior accuracy, computational efficiency, and adaptability of our method compared to state-of-the-art online GPSSM techniques.
Code (2)
Tasks
Computational EfficiencyHyperparameter OptimizationmodelState Space ModelsTime Series PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Numerical Gaussian process Kalman filtering for spatiotemporal systems
We present a novel Kalman filter for spatiotemporal systems called the numerical Gaussian process Kalman filter (GPKF). Numerical Gaussian processes have recently been introduced as a physics informed machine learning me…
BIG-bench Machine LearningGaussian ProcessesPhysics-informed machine learningLearning Driver Behaviors Using A Gaussian Process Augmented State-Space Model
An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performanc…
PositionState Space ModelsStatistics on the (compact) Stiefel manifold: Theory and Applications
A Stiefel manifold of the compact type is often encountered in many fields of Engineering including, signal and image processing, machine learning, numerical optimization and others. The Stiefel manifold is a Riemannian …
A Marginalized Particle Gaussian Process Regression
We present a novel marginalized particle Gaussian process (MPGP) regression, which provides a fast, accurate online Bayesian filtering framework to model the latent function. Using a state space model established by the …
Computational EfficiencyregressionRecursive Entropic Variational Inference for Nonlinear State-Space Models
We present a class of algorithms for state estimation in nonlinear, non-Gaussian state-space models. Our approach is based on a variational Lagrangian formulation that casts Bayesian inference as a sequence of entropic t…
Bayesian Inference