paper-with-me

Papers

Distributional Gaussian Processes Layers for Out-of-Distribution Detection

2022-06-27 · Sebastian G. Popescu, David J. Sharp, James H. Cole, Konstantinos Kamnitsas, Ben Glocker

Machine learning models deployed on medical imaging tasks must be equipped with out-of-distribution detection capabilities in order to avoid erroneous predictions. It is unsure whether out-of-distribution detection models reliant on deep neural networks are suitable for detecting domain shifts in medical imaging. Gaussian Processes can reliably separate in-distribution data points from out-of-distribution data points via their mathematical construction. Hence, we propose a parameter efficient Bayesian layer for hierarchical convolutional Gaussian Processes that incorporates Gaussian Processes operating in Wasserstein-2 space to reliably propagate uncertainty. This directly replaces convolving Gaussian Processes with a distance-preserving affine operator on distributions. Our experiments on brain tissue-segmentation show that the resulting architecture approaches the performance of well-established deterministic segmentation algorithms (U-Net), which has not been achieved with previous hierarchical Gaussian Processes. Moreover, by applying the same segmentation model to out-of-distribution data (i.e., images with pathology such as brain tumors), we show that our uncertainty estimates result in out-of-distribution detection that outperforms the capabilities of previous Bayesian networks and reconstruction-based approaches that learn normative distributions. To facilitate future work our code is publicly available.

📄 PDF Abstract BibTeX arXiv:2206.13346

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesOut-of-Distribution DetectionSegmentation

Methods 이 논문이 사용한 방법론

Affine Operator 설명 없음

Similar Papers 제목 키워드 기반

Distributional Gaussian Process Layers for Outlier Detection in Image Segmentation

2021-04-28 · Sebastian G. Popescu, David J. Sharp, James H. Cole, Konstantinos Kamnitsas 외

We propose a parameter efficient Bayesian layer for hierarchical convolutional Gaussian Processes that incorporates Gaussian Processes operating in Wasserstein-2 space to reliably propagate uncertainty. This directly rep…

Gaussian ProcessesImage SegmentationOutlier DetectionOut-of-Distribution Detection+2

Quantitative Gaussian Approximation of Randomly Initialized Deep Neural Networks

2022-03-14 · Andrea Basteri, Dario Trevisan

Given any deep fully connected neural network, initialized with random Gaussian parameters, we bound from above the quadratic Wasserstein distance between its output distribution and a suitable Gaussian process. Our expl…

Distributionally Robust Model Predictive Control with Mixture of Gaussian Processes

2025-02-08 · Jingyi Wu, Chao Ning

Despite the success of Gaussian process based Model Predictive Control (MPC) in robotic control, its applicability scope is greatly hindered by multimodal disturbances that are prevalent in real-world settings. Here we p…

Gaussian ProcessesModel Predictive Control

Distributionally Robust Model-based Reinforcement Learning with Large State Spaces

2023-09-05 · Shyam Sundhar Ramesh, Pier Giuseppe Sessa, Yifan Hu, Andreas Krause 외

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment de…

Gaussian ProcessesModel-based Reinforcement Learningreinforcement-learningReinforcement Learning

Gaussian Processes and Reproducing Kernels: Connections and Equivalences

2025-06-20 · Motonobu Kanagawa, Philipp Hennig, Dino Sejdinovic, Bharath K. Sriperumbudur

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). T…

Gaussian ProcessesNumerical Integration