Temporal Gaussian Process Regression in Logarithmic Time
The aim of this article is to present a novel parallelization method for temporal Gaussian process (GP) regression problems. The method allows for solving GP regression problems in logarithmic O(log N) time, where N is the number of time steps. Our approach uses the state-space representation of GPs which in its original form allows for linear O(N) time GP regression by leveraging the Kalman filtering and smoothing methods. By using a recently proposed parallelization method for Bayesian filters and smoothers, we are able to reduce the linear computational complexity of the temporal GP regression problems into logarithmic span complexity. This ensures logarithmic time complexity when run on parallel hardware such as a graphics processing unit (GPU). We experimentally demonstrate the computational benefits on simulated and real datasets via our open-source implementation leveraging the GPflow framework.
Code (1)
Tasks
GPUregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bayesian autoregression to optimize temporal Matérn kernel Gaussian process hyperparameters
Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Matérn kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparame…
Gaussian ProcessesDeep Horseshoe Gaussian Processes
Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bay…
Gaussian ProcessesregressionSpatio-Temporal Variational Gaussian Processes
We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales…
Gaussian ProcessesVariational InferenceGauss-Legendre Features for Gaussian Process Regression
Gaussian processes provide a powerful probabilistic kernel learning framework, which allows learning high quality nonparametric regression models via methods such as Gaussian process regression. Nevertheless, the learnin…
Gaussian ProcessesNumerical IntegrationregressionSpatio-Temporal Structured Sparse Regression with Hierarchical Gaussian Process Priors
This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the …
Bayesian InferenceEEGElectroencephalogram (EEG)object-detection+2