Bayesian Image Classification with Deep Convolutional Gaussian Processes

2019-02-15 · Vincent Dutordoir, Mark van der Wilk, Artem Artemev, James Hensman

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty estimates and a marginal likelihood objective, but their weak inductive biases lead to inferior accuracy. This has limited their applicability in certain tasks (e.g. image classification). We propose a translation-insensitive convolutional kernel, which relaxes the translation invariance constraint imposed by previous convolutional GPs. We show how we can use the marginal likelihood to learn the degree of insensitivity. We also reformulate GP image-to-image convolutional mappings as multi-output GPs, leading to deep convolutional GPs. We show experimentally that our new kernel improves performance in both single-layer and deep models. We also demonstrate that our fully Bayesian approach improves on dropout-based Bayesian deep learning methods in terms of uncertainty and marginal likelihood estimates.

📄 PDF Abstract BibTeX arXiv:1902.05888

Code (0)

등록된 구현이 없습니다.

Tasks

Classification Decision Making Gaussian Processes General Classification image-classification Image ClassificationModel SelectionTranslation

Deep convolutional Gaussian processes

2018-10-06 · Kenneth Blomqvist, Samuel Kaski, Markus Heinonen

We propose deep convolutional Gaussian processes, a deep Gaussian process architecture with convolutional structure. The model is a principled Bayesian framework for detecting hierarchical combinations of local features …

Classification Gaussian Processes General Classification image-classification+1

Graph Convolutional Gaussian Processes

2019-05-14 · Ian Walker, Ben Glocker

We propose a novel Bayesian nonparametric method to learn translation-invariant relationships on non-Euclidean domains. The resulting graph convolutional Gaussian processes can be applied to problems in machine learning …

BIG-bench Machine Learning Gaussian Processes Superpixel Image Classification Translation

Deep Gaussian Processes with Convolutional Kernels

2018-06-05 · Vinayak Kumar, Vaibhav Singh, P. K. Srijith, Andreas Damianou

Deep Gaussian processes (DGPs) provide a Bayesian non-parametric alternative to standard parametric deep learning models. A DGP is formed by stacking multiple GPs resulting in a well-regularized composition of functions.…

Gaussian Processes image-classification Image Classification

Distributional Gaussian Process Layers for Outlier Detection in Image Segmentation

2021-04-28 · Sebastian G. Popescu, David J. Sharp, James H. Cole, Konstantinos Kamnitsas 외

We propose a parameter efficient Bayesian layer for hierarchical convolutional Gaussian Processes that incorporates Gaussian Processes operating in Wasserstein-2 space to reliably propagate uncertainty. This directly rep…

Gaussian Processes Image Segmentation Outlier Detection Out-of-Distribution Detection+2

Distributional Gaussian Processes Layers for Out-of-Distribution Detection

2022-06-27 · Sebastian G. Popescu, David J. Sharp, James H. Cole, Konstantinos Kamnitsas 외

Machine learning models deployed on medical imaging tasks must be equipped with out-of-distribution detection capabilities in order to avoid erroneous predictions. It is unsure whether out-of-distribution detection model…

Gaussian Processes Out-of-Distribution Detection Segmentation