Deep State-Space Gaussian Processes
This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic differential equations (SDEs), where each SDE corresponds to a conditional GP. The DGP regression problem then becomes a state estimation problem, and we can estimate the state efficiently with sequential methods by using the Markov property of the state-space DGP. The computational complexity scales linearly with respect to the number of measurements. Based on this, we formulate state-space MAP as well as Bayesian filtering and smoothing solutions to the DGP regression problem. We demonstrate the performance of the proposed models and methods on synthetic non-stationary signals and apply the state-space DGP to detection of the gravitational waves from LIGO measurements.
Code (1)
Tasks
Gaussian ProcessesregressionState EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sequential Estimation of Gaussian Process-based Deep State-Space Models
We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussia…
Gaussian ProcessesState Space ModelsThe Use of Gaussian Processes in System Identification
Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistic…
FormGaussian ProcessesState Space ModelsTime Series+2Doubly Sparse Variational Gaussian Processes
The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitatio…
Gaussian ProcessesState Space ModelsvalidOnline Time Series Anomaly Detection with State Space Gaussian Processes
We propose r-ssGPFA, an unsupervised online anomaly detection model for uni- and multivariate time series building on the efficient state space formulation of Gaussian processes. For high-dimensional time series, we prop…
Anomaly DetectionGaussian ProcessesTime SeriesTime Series Analysis+1State Space representation of non-stationary Gaussian Processes
The state space (SS) representation of Gaussian processes (GP) has recently gained a lot of interest. The main reason is that it allows to compute GPs based inferences in O(n), where $n$ is the number of observations. Th…
BIG-bench Machine LearningGaussian Processes