MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validation
Gaussian processes (GPs) are non-linear probabilistic models popular in many applications. However, na\"ive GP realizations require quadratic memory to store the covariance matrix and cubic computation to perform inference or evaluate the likelihood function. These bottlenecks have driven much investment in the development of approximate GP alternatives that scale to the large data sizes common in modern data-driven applications. We present in this manuscript MuyGPs, a novel efficient GP hyperparameter estimation method. MuyGPs builds upon prior methods that take advantage of the nearest neighbors structure of the data, and uses leave-one-out cross-validation to optimize covariance (kernel) hyperparameters without realizing a possibly expensive likelihood. We describe our model and methods in detail, and compare our implementations against the state-of-the-art competitors in a benchmark spatial statistics problem. We show that our method outperforms all known competitors both in terms of time-to-solution and the root mean squared error of the predictions.
Code (2)
Tasks
Gaussian ProcessesSimilar Papers 제목 키워드 기반
Fast Gaussian Process Posterior Mean Prediction via Local Cross Validation and Precomputation
Gaussian processes (GPs) are Bayesian non-parametric models useful in a myriad of applications. Despite their popularity, the cost of GP predictions (quadratic storage and cubic complexity with respect to the number of t…
Gaussian ProcessesPredictionScalable Gaussian Process Hyperparameter Optimization via Coverage Regularization
Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the valid…
Conformal PredictionGaussian ProcessesHyperparameter OptimizationPrediction+1Light curve completion and forecasting using fast and scalable Gaussian processes (MuyGPs)
Temporal variations of apparent magnitude, called light curves, are observational statistics of interest captured by telescopes over long periods of time. Light curves afford the exploration of Space Domain Awareness (SD…
Gaussian ProcessesPose EstimationTime SeriesTime Series AnalysisScalable Hyperparameter Optimization with Products of Gaussian Process Experts
In machine learning, hyperparameter optimization is a challenging but necessary task that is usually approached in a computationally expensive manner such as grid-search. Out of this reason, surrogate based black-box opt…
Gaussian ProcessesHyperparameter OptimizationScalable Bayesian Transformed Gaussian Processes
The Bayesian transformed Gaussian process (BTG) model, proposed by Kedem and Oliviera, is a fully Bayesian counterpart to the warped Gaussian process (WGP) and marginalizes out a joint prior over input warping and kernel…
Gaussian ProcessesModel Selection