paper-with-me

홈 › Papers

Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS

2022-11-03 · Rishabh Singh, Jose C. Principe

Deep learning models for semantic segmentation are prone to poor performance in real-world applications due to the highly challenging nature of the task. Model uncertainty quantification (UQ) is one way to address this issue of lack of model trustworthiness by enabling the practitioner to know how much to trust a segmentation output. Current UQ methods in this application domain are mainly restricted to Bayesian based methods which are computationally expensive and are only able to extract central moments of uncertainty thereby limiting the quality of their uncertainty estimates. We present a simple framework for high-resolution predictive uncertainty quantification of semantic segmentation models that leverages a multi-moment functional definition of uncertainty associated with the model's feature space in the reproducing kernel Hilbert space (RKHS). The multiple uncertainty functionals extracted from this framework are defined by the local density dynamics of the model's feature space and hence automatically align themselves at the tail-regions of the intrinsic probability density function of the feature space (where uncertainty is the highest) in such a way that the successively higher order moments quantify the more uncertain regions. This leads to a significantly more accurate view of model uncertainty than conventional Bayesian methods. Moreover, the extraction of such moments is done in a single-shot computation making it much faster than Bayesian and ensemble approaches (that involve a high number of forward stochastic passes of the model to quantify its uncertainty). We demonstrate these advantages through experimental evaluations of our framework implemented over four different state-of-the-art model architectures that are trained and evaluated on two benchmark road-scene segmentation datasets (Camvid and Cityscapes).

📄 PDF Abstract BibTeX arXiv:2211.01999

Code (0)

등록된 구현이 없습니다.

Tasks

Scene SegmentationSegmentationSemantic SegmentationUncertainty Quantification

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Towards a Kernel based Uncertainty Decomposition Framework for Data and Models

2020-01-30 · Rishabh Singh, Jose C. Principe

This paper introduces a new framework for quantifying predictive uncertainty for both data and models that relies on projecting the data into a Gaussian reproducing kernel Hilbert space (RKHS) and transforming the data p…

Time Series AnalysisUncertainty Quantification

Uncertainty Aware Proposal Segmentation for Unknown Object Detection

2021-11-25 · Yimeng Li, Jana Kosecka

Recent efforts in deploying Deep Neural Networks for object detection in real world applications, such as autonomous driving, assume that all relevant object classes have been observed during training. Quantifying the pe…

Autonomous DrivingObjectobject-detectionObject Detection+3

Composition operators on reproducing kernel Hilbert spaces with analytic positive definite functions

2019-11-27 · Masahiro Ikeda, Isao Ishikawa, Yoshihiro Sawano

In this paper, we specify what functions induce the bounded composition operators on a reproducing kernel Hilbert space (RKHS) associated with an analytic positive definite function defined on $\mathbf{R}^d$. We prove th…

RKHS Representation of Algebraic Convolutional Filters with Integral Operators

2026-02-22 · Alejandro Parada-Mayorga, Alejandro Ribeiro, Juan Bazerque arxiv

Integral operators play a central role in signal processing, underpinning classical convolution, and filtering on continuous network models such as graphons. While these operators are traditionally analyzed through spect…

Deep Deterministic Uncertainty for Semantic Segmentation

2021-10-29 · Jishnu Mukhoti, Joost van Amersfoort, Philip H. S. Torr, Yarin Gal

We extend Deep Deterministic Uncertainty (DDU), a method for uncertainty estimation using feature space densities, to semantic segmentation. DDU enables quantifying and disentangling epistemic and aleatoric uncertainty i…

SegmentationSemantic Segmentation