paper-with-me

Papers

The Variational Gaussian Process

2015-11-20 · Dustin Tran, Rajesh Ranganath, David M. Blei

Variational inference is a powerful tool for approximate inference, and it has been recently applied for representation learning with deep generative models. We develop the variational Gaussian process (VGP), a Bayesian nonparametric variational family, which adapts its shape to match complex posterior distributions. The VGP generates approximate posterior samples by generating latent inputs and warping them through random non-linear mappings; the distribution over random mappings is learned during inference, enabling the transformed outputs to adapt to varying complexity. We prove a universal approximation theorem for the VGP, demonstrating its representative power for learning any model. For inference we present a variational objective inspired by auto-encoders and perform black box inference over a wide class of models. The VGP achieves new state-of-the-art results for unsupervised learning, inferring models such as the deep latent Gaussian model and the recently proposed DRAW.

📄 PDF Abstract BibTeX arXiv:1511.06499

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningVariational Inference

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Variational Elliptical Processes

2023-11-21 · Maria Bånkestad, Jens Sjölund, Jalil Taghia, Thomas B. Schöon

We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaini…

Gaussian ProcessesVariational Inference

Variational Inference for Gaussian Process Models with Linear Complexity

2017-11-28 · NeurIPS 2017 12 · Ching-An Cheng, Byron Boots

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning fr…

Variational Inference

Deep recurrent Gaussian process with variational Sparse Spectrum approximation

2019-09-27 · Roman Föll, Bernard Haasdonk, Markus Hanselmann, Holger Ulmer

Modeling sequential data has become more and more important in practice. Some applications are autonomous driving, virtual sensors and weather forecasting. To model such systems, so called recurrent models are frequently…

Autonomous DrivingWeather Forecasting

Variational Inference for Mahalanobis Distance Metrics in Gaussian Process Regression

2013-12-01 · NeurIPS 2013 12 · Michalis Titsias Rc Aueb, Miguel Lazaro-Gredilla

We introduce a novel variational method that allows to approximately integrate out kernel hyperparameters, such as length-scales, in Gaussian process regression. This approach consists of a novel variant of the variation…

regressionVariational Inference

Deep Gaussian Processes with Importance-Weighted Variational Inference

2019-05-14 · Hugh Salimbeni, Vincent Dutordoir, James Hensman, Marc Peter Deisenroth

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating unco…

Gaussian ProcessesVariational Inference