paper-with-me

Papers

Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural Networks with Variational Inference

2018-06-15 · Kumar Shridhar, Felix Laumann, Marcus Liwicki

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and epistemic uncertainty in a coherent manner. The intractable posterior probability distributions over weights are inferred by Bayes by Backprop. Firstly, we demonstrate how this reliable variational inference method can serve as a fundamental construct for various network architectures. On multiple datasets in supervised learning settings (MNIST, CIFAR-10, CIFAR-100), this variational inference method achieves performances equivalent to frequentist inference in identical architectures, while the two desiderata, a measure for uncertainty and regularization are incorporated naturally. Secondly, we examine how our proposed measure for aleatoric and epistemic uncertainties is derived and validate it on the aforementioned datasets.

📄 PDF Abstract BibTeX arXiv:1806.05978

Code (9)

Anou9531/Bayesian-CNN pytorch
MindSpore-scientific-2/code-1/tree/main/Uncertainty_Calibration_Object_Detection mindspore
MindSpore-scientific-2/code-11/tree/main/Uncertainty_Calibration_Object_Detection mindspore
MindSpore-scientific-2/code-2/tree/main/Uncertainty_Calibration_Object_Detection mindspore
MindSpore-scientific-2/code-8/tree/main/Uncertainty_Calibration_Object_Detection mindspore
kumar-shridhar/BayesianConvNet pytorch
kumar-shridhar/PyTorch-BayesianCNN pytorch
liqichen6688/baycnn pytorch
nomercy77/Implementing-Bayesian-CNN pytorch

Tasks

Bayesian InferenceGeneral ClassificationVariational Inference

Methods 이 논문이 사용한 방법론

(TravEL!!Guide)How Do I File a Claim with Expedia? How Do I File a Claim with Expedia? Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Fast Help & Exclusive Travel Discounts!Need to file a claim with…

Similar Papers 제목 키워드 기반

Permuted and Augmented Stick-Breaking Bayesian Multinomial Regression

2016-12-30 · Quan Zhang, Mingyuan Zhou

To model categorical response variables given their covariates, we propose a permuted and augmented stick-breaking (paSB) construction that one-to-one maps the observed categories to randomly permuted latent sticks. This…

regression

Softplus Regressions and Convex Polytopes

2016-08-23 · Mingyuan Zhou

To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stack…

Bayesian InferenceData Augmentationregression

RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimations

2017-09-09 · Shuochao Yao, Yiran Zhao, Huajie Shao, Aston Zhang 외

Recent advances in deep learning have led various applications to unprecedented achievements, which could potentially bring higher intelligence to a broad spectrum of mobile and ubiquitous applications. Although existing…

scoring rule

Stochastic Normalizations as Bayesian Learning

2018-11-01 · Alexander Shekhovtsov, Boris Flach

In this work we investigate the reasons why Batch Normalization (BN) improves the generalization performance of deep networks. We argue that one major reason, distinguishing it from data-independent normalization methods…

Measuring Classification Decision Certainty and Doubt

2023-03-25 · Alexander M. Berenbeim, Iain J. Cruickshank, Susmit Jha, Robert H. Thomson 외

Quantitative characterizations and estimations of uncertainty are of fundamental importance in optimization and decision-making processes. Herein, we propose intuitive scores, which we call certainty and doubt, that can …

ClassificationDecision Making