Parametric Gaussian Process Regressors
The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially underestimated uncertainties. Notably, in the regression case the predictive variance is typically dominated by observation noise, yielding uncertainty estimates that make little use of the input-dependent function uncertainty that makes GP priors attractive. In this work we propose two simple methods for scalable GP regression that address this issue and thus yield substantially improved predictive uncertainties. The first applies variational inference to FITC (Fully Independent Training Conditional; Snelson et.~al.~2006). The second bypasses posterior approximations and instead directly targets the posterior predictive distribution. In an extensive empirical comparison with a number of alternative methods for scalable GP regression, we find that the resulting predictive distributions exhibit significantly better calibrated uncertainties and higher log likelihoods--often by as much as half a nat per datapoint.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Bootstrap Specification Test for Semiparametric Models with Generated Regressors
This paper provides a specification test for semiparametric models with nonparametrically generated regressors. Such variables are not observed by the researcher but are nonparametrically identified and estimable. Applic…
validIt is all in the noise: Efficient multi-task Gaussian process inference with structured residuals
Multi-task prediction models are widely being used to couple regressors or classification models by sharing information across related tasks. A common pitfall of these models is that they assume that the output tasks are…
AllGeneral ClassificationPredictionKaoLRM: Repurposing Pre-trained Large Reconstruction Models for Parametric 3D Face Reconstruction
We propose KaoLRM to re-target the learned prior of the Large Reconstruction Model (LRM) for parametric 3D face reconstruction from single-view images. Parametric 3D Morphable Models (3DMMs) have been widely used for fac…
3D Face ReconstructionLearning safety in model-based Reinforcement Learning using MPC and Gaussian Processes
We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as …
Gaussian ProcessesModel-based Reinforcement LearningModel Predictive Controlreinforcement-learning+1Gradient Weights help Nonparametric Regressors
In regression problems over $\real^d$, the unknown function $f$ often varies more in some coordinates than in others. We show that weighting each coordinate $i$ with the estimated norm of the $i$th derivative of $f$ is …
regression