Robust Deep Gaussian Processes
This report provides an in-depth overview over the implications and novelty Generalized Variational Inference (GVI) (Knoblauch et al., 2019) brings to Deep Gaussian Processes (DGPs) (Damianou & Lawrence, 2013). Specifically, robustness to model misspecification as well as principled alternatives for uncertainty quantification are motivated with an information-geometric view. These modifications have clear interpretations and can be implemented in less than 100 lines of Python code. Most importantly, the corresponding empirical results show that DGPs can greatly benefit from the presented enhancements.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesUncertainty QuantificationVariational InferenceSimilar Papers 제목 키워드 기반
Upgrading from Gaussian Processes to Student's-T Processes
Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the poster…
Bayesian OptimizationGaussian ProcessesThe Use of Gaussian Processes in System Identification
Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistic…
FormGaussian ProcessesState Space ModelsTime Series+2GaussianProcesses.jl: A Nonparametric Bayes package for the Julia Language
Gaussian processes are a class of flexible nonparametric Bayesian tools that are widely used across the sciences, and in industry, to model complex data sources. Key to applying Gaussian process models is the availabilit…
Binary ClassificationGaussian ProcessesVariational Elliptical Processes
We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaini…
Gaussian ProcessesVariational InferenceSequential Estimation of Gaussian Process-based Deep State-Space Models
We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussia…
Gaussian ProcessesState Space Models