paper-with-me

홈 › Papers

Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems

2025-03-24 · Zhidi Lin, Ying Li, Feng Yin, Juan Maroñas, Alexandre H. Thiéry

Gaussian process state-space models (GPSSMs) offer a principled framework for learning and inference in nonlinear dynamical systems with uncertainty quantification. However, existing GPSSMs are limited by the use of multiple independent stationary Gaussian processes (GPs), leading to prohibitive computational and parametric complexity in high-dimensional settings and restricted modeling capacity for non-stationary dynamics. To address these challenges, we propose an efficient transformed Gaussian process state-space model (ETGPSSM) for scalable and flexible modeling of high-dimensional, non-stationary dynamical systems. Specifically, our ETGPSSM integrates a single shared GP with input-dependent normalizing flows, yielding an expressive implicit process prior that captures complex, non-stationary transition dynamics while significantly reducing model complexity. For the inference of the implicit process, we develop a variational inference algorithm that jointly approximates the posterior over the underlying GP and the neural network parameters defining the normalizing flows. To avoid explicit variational parameterization of the latent states, we further incorporate the ensemble Kalman filter (EnKF) into the variational framework, enabling accurate and efficient state estimation. Extensive empirical evaluations on synthetic and real-world datasets demonstrate the superior performance of our ETGPSSM in system dynamics learning, high-dimensional state estimation, and time-series forecasting, outperforming existing GPSSMs and neural network-based SSMs in terms of computational efficiency and accuracy.

📄 PDF Abstract BibTeX arXiv:2503.18309

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGaussian ProcessesState EstimationState Space ModelsTime Series ForecastingUncertainty QuantificationVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Deep State-Space Gaussian Processes

2020-08-11 · Zheng Zhao, Muhammad Emzir, Simo Särkkä

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes o…

Gaussian ProcessesregressionState Estimation

Efficient Transformed Gaussian Processes for Non-Stationary Dependent Multi-class Classification

2022-05-30 · Juan Maroñas, Daniel Hernández-Lobato

This work introduces the Efficient Transformed Gaussian Process (ETGP), a new way of creating C stochastic processes characterized by: 1) the C processes are non-stationary, 2) the C processes are dependent by constructi…

Gaussian ProcessesMulti-class ClassificationVariational Inference

Input Warping for Bayesian Optimization of Non-stationary Functions

2014-02-05 · Jasper Snoek, Kevin Swersky, Richard S. Zemel, Ryan P. Adams

Bayesian optimization has proven to be a highly effective methodology for the global optimization of unknown, expensive and multimodal functions. The ability to accurately model distributions over functions is critical t…

Bayesian OptimizationGaussian Processesglobal-optimization

State Space representation of non-stationary Gaussian Processes

2016-01-07 · Alessio Benavoli, Marco Zaffalon

The state space (SS) representation of Gaussian processes (GP) has recently gained a lot of interest. The main reason is that it allows to compute GPs based inferences in O(n), where $n$ is the number of observations. Th…

BIG-bench Machine LearningGaussian Processes

Gaussian Process Kernels for Popular State-Space Time Series Models

2016-10-25 · Alexander Grigorievskiy, Juha Karhunen

In this paper we investigate a link between state- space models and Gaussian Processes (GP) for time series modeling and forecasting. In particular, several widely used state- space models are transformed into continuous…

Gaussian ProcessesregressionState Space ModelsTime Series+1