Deep Gaussian Processes

2012-11-02 · Andreas C. Damianou, Neil D. Lawrence

In this paper we introduce deep Gaussian process (GP) models. Deep GPs are a deep belief network based on Gaussian process mappings. The data is modeled as the output of a multivariate GP. The inputs to that Gaussian process are then governed by another GP. A single layer model is equivalent to a standard GP or the GP latent variable model (GP-LVM). We perform inference in the model by approximate variational marginalization. This results in a strict lower bound on the marginal likelihood of the model which we use for model selection (number of layers and nodes per layer). Deep belief networks are typically applied to relatively large data sets using stochastic gradient descent for optimization. Our fully Bayesian treatment allows for the application of deep models even when data is scarce. Model selection by our variational bound shows that a five layer hierarchy is justified even when modelling a digit data set containing only 150 examples.

📄 PDF Abstract BibTeX arXiv:1211.0358

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesModel Selection

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Upgrading from Gaussian Processes to Student's-T Processes

2018-01-18 · Brendan D. Tracey, David H. Wolpert

Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the poster…

Bayesian Optimization Gaussian Processes

The Use of Gaussian Processes in System Identification

2019-07-13 · Simo Särkkä

Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistic…

Form Gaussian Processes State Space Models Time Series+2

GaussianProcesses.jl: A Nonparametric Bayes package for the Julia Language

2018-12-21 · Jamie Fairbrother, Christopher Nemeth, Maxime Rischard, Johanni Brea 외

Gaussian processes are a class of flexible nonparametric Bayesian tools that are widely used across the sciences, and in industry, to model complex data sources. Key to applying Gaussian process models is the availabilit…

Binary Classification Gaussian Processes

Variational Elliptical Processes

2023-11-21 · Maria Bånkestad, Jens Sjölund, Jalil Taghia, Thomas B. Schöon

We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaini…

Gaussian Processes Variational Inference

Sequential Estimation of Gaussian Process-based Deep State-Space Models

2023-01-29 · Yuhao Liu, Marzieh Ajirak, Petar Djuric

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussia…

Gaussian Processes State Space Models