paper-with-me

Papers

Parametric Gaussian Process Regressors

2019-10-16 · ICML 2020 1 · Martin Jankowiak, Geoff Pleiss, Jacob R. Gardner

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially underestimated uncertainties. Notably, in the regression case the predictive variance is typically dominated by observation noise, yielding uncertainty estimates that make little use of the input-dependent function uncertainty that makes GP priors attractive. In this work we propose two simple methods for scalable GP regression that address this issue and thus yield substantially improved predictive uncertainties. The first applies variational inference to FITC (Fully Independent Training Conditional; Snelson et.~al.~2006). The second bypasses posterior approximations and instead directly targets the posterior predictive distribution. In an extensive empirical comparison with a number of alternative methods for scalable GP regression, we find that the resulting predictive distributions exhibit significantly better calibrated uncertainties and higher log likelihoods--often by as much as half a nat per datapoint.

📄 PDF Abstract BibTeX arXiv:1910.07123

Code (0)

등록된 구현이 없습니다.

Tasks

regressionVariational Inference

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

A Bootstrap Specification Test for Semiparametric Models with Generated Regressors

2022-12-21 · Elia Lapenta

This paper provides a specification test for semiparametric models with nonparametrically generated regressors. Such variables are not observed by the researcher but are nonparametrically identified and estimable. Applic…

valid

It is all in the noise: Efficient multi-task Gaussian process inference with structured residuals

2013-12-01 · NeurIPS 2013 12 · Barbara Rakitsch, Christoph Lippert, Karsten Borgwardt, Oliver Stegle

Multi-task prediction models are widely being used to couple regressors or classification models by sharing information across related tasks. A common pitfall of these models is that they assume that the output tasks are…

AllGeneral ClassificationPrediction

KaoLRM: Repurposing Pre-trained Large Reconstruction Models for Parametric 3D Face Reconstruction

2026-01-19 · Qingtian Zhu, Xu Cao, Zhixiang Wang, Yinqiang Zheng 외 arxiv

We propose KaoLRM to re-target the learned prior of the Large Reconstruction Model (LRM) for parametric 3D face reconstruction from single-view images. Parametric 3D Morphable Models (3DMMs) have been widely used for fac…

3D Face Reconstruction

Learning safety in model-based Reinforcement Learning using MPC and Gaussian Processes

2022-11-03 · Filippo Airaldi, Bart De Schutter, Azita Dabiri

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as …

Gaussian ProcessesModel-based Reinforcement LearningModel Predictive Controlreinforcement-learning+1

Gradient Weights help Nonparametric Regressors

2012-12-01 · NeurIPS 2012 12 · Samory Kpotufe, Abdeslam Boularias

In regression problems over $\real^d$, the unknown function $f$ often varies more in some coordinates than in others. We show that weighting each coordinate $i$ with the estimated norm of the $i$th derivative of $f$ is …

regression