paper-with-me

Papers

Efficiently Sampling Functions from Gaussian Process Posteriors

2020-02-21 · ICML 2020 1 · James T. Wilson, Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky, Marc Peter Deisenroth

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of larger frameworks, wherein quantities of interest are ultimately defined by integrating over posterior distributions. These quantities are frequently intractable, motivating the use of Monte Carlo methods. Despite substantial progress in scaling up Gaussian processes to large training sets, methods for accurately generating draws from their posterior distributions still scale cubically in the number of test locations. We identify a decomposition of Gaussian processes that naturally lends itself to scalable sampling by separating out the prior from the data. Building off of this factorization, we propose an easy-to-use and general-purpose approach for fast posterior sampling, which seamlessly pairs with sparse approximations to afford scalability both during training and at test time. In a series of experiments designed to test competing sampling schemes' statistical properties and practical ramifications, we demonstrate how decoupled sample paths accurately represent Gaussian process posteriors at a fraction of the usual cost.

📄 PDF Abstract BibTeX arXiv:2002.09309

Code (5)

j-wilson/GPflowSampling 공식 구현 tf
anh-tong/stan_playground pytorch
aterenin/SparseGaussianProcesses.jl
j-wilson/GPflowPILCO tf
saitcakmak/gp-sampling pytorch

Tasks

Gaussian Processes

Methods 이 논문이 사용한 방법론

Test 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Pathwise Conditioning of Gaussian Processes

2020-11-08 · James T. Wilson, Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky 외

As Gaussian processes are used to answer increasingly complex questions, analytic solutions become scarcer and scarcer. Monte Carlo methods act as a convenient bridge for connecting intractable mathematical expressions w…

Gaussian Processesglobal-optimization

Look-Ahead Acquisition Functions for Bernoulli Level Set Estimation

2022-03-18 · Benjamin Letham, Phillip Guan, Chase Tymms, Eytan Bakshy 외

Level set estimation (LSE) is the problem of identifying regions where an unknown function takes values above or below a specified threshold. Active sampling strategies for efficient LSE have primarily been studied in co…

Automated Variational Inference for Gaussian Process Models

2014-12-01 · NeurIPS 2014 12 · Trung V. Nguyen, Edwin V. Bonilla

We develop an automated variational method for approximate inference in Gaussian process (GP) models whose posteriors are often intractable. Using a mixture of Gaussians as the variational distribution, we show that (i) …

Variational Inference

MCMC for Variationally Sparse Gaussian Processes

2015-06-12 · NeurIPS 2015 12 · James Hensman, Alexander G. de G. Matthews, Maurizio Filippone, Zoubin Ghahramani

Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data i…

FormGaussian Processes

Function-Space Distributions over Kernels

2019-10-29 · NeurIPS 2019 12 · Gregory W. Benton, Wesley J. Maddox, Jayson P. Salkey, Julio Albinati 외

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper,…

Gaussian ProcessesRepresentation Learning