Fast methods for training Gaussian processes on large data sets
Gaussian process regression (GPR) is a non-parametric Bayesian technique for interpolating or fitting data. The main barrier to further uptake of this powerful tool rests in the computational costs associated with the matrices which arise when dealing with large data sets. Here, we derive some simple results which we have found useful for speeding up the learning stage in the GPR algorithm, and especially for performing Bayesian model comparison between different covariance functions. We apply our techniques to both synthetic and real data and quantify the speed-up relative to using nested sampling to numerically evaluate model evidences.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesGPRregressionSimilar Papers 제목 키워드 기반
GPatt: Fast Multidimensional Pattern Extrapolation with Gaussian Processes
Gaussian processes are typically used for smoothing and interpolation on small datasets. We introduce a new Bayesian nonparametric framework -- GPatt -- enabling automatic pattern extrapolation with Gaussian processes on…
Gaussian ProcessesFast Bayesian Inference for Gaussian Cox Processes via Path Integral Formulation
Gaussian Cox processes are widely-used point process models that use a Gaussian process to describe the Bayesian a priori uncertainty present in latent intensity functions. In this paper, we propose a novel Bayesian infe…
Bayesian InferenceEfficiently Sampling Functions from Gaussian Process Posteriors
Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically…
Gaussian ProcessesLarge-Scale Gaussian Processes via Alternating Projection
Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative m…
Gaussian ProcessesHyperparameter OptimizationIntegrated Variational Fourier Features for Fast Spatial Modelling with Gaussian Processes
Sparse variational approximations are popular methods for scaling up inference and learning in Gaussian processes to larger datasets. For $N$ training points, exact inference has $O(N^3)$ cost; with $M \ll N$ features, s…
Gaussian Processes