paper-with-me

홈 › Papers

Quantifying Uncertainty in Deep Learning Classification with Noise in Discrete Inputs for Risk-Based Decision Making

2023-10-09 · Maryam Kheirandish, Shengfan Zhang, Donald G. Catanzaro, Valeriu Crudu

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision making, prediction confidence or uncertainty should be assessed alongside the overall performance of algorithms. Recent studies on Bayesian deep learning helps quantify prediction uncertainty arises from input noises and model parameters. However, the normality assumption of input noise in these models limits their applicability to problems involving categorical and discrete feature variables in tabular datasets. In this paper, we propose a mathematical framework to quantify prediction uncertainty for DNN models. The prediction uncertainty arises from errors in predictors that follow some known finite discrete distribution. We then conducted a case study using the framework to predict treatment outcome for tuberculosis patients during their course of treatment. The results demonstrate under a certain level of risk, we can identify risk-sensitive cases, which are prone to be misclassified due to error in predictors. Comparing to the Monte Carlo dropout method, our proposed framework is more aware of misclassification cases. Our proposed framework for uncertainty quantification in deep learning can support risk-based decision making in applications when discrete errors in predictors are present.

📄 PDF Abstract BibTeX arXiv:2310.06105

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingPredictionUncertainty Quantification

Methods 이 논문이 사용한 방법론

Monte Carlo Dropout 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Quantifying and Understanding Adversarial Examples in Discrete Input Spaces

2021-12-12 · Volodymyr Kuleshov, Evgenii Nikishin, Shantanu Thakoor, Tingfung Lau 외

Modern classification algorithms are susceptible to adversarial examples--perturbations to inputs that cause the algorithm to produce undesirable behavior. In this work, we seek to understand and extend adversarial examp…

AttributeSentiment Analysis

Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation

2024-12-10 · CVPR 2025 1 · Tal Zeevi, Ravid Shwartz-Ziv, Yann Lecun, Lawrence H. Staib 외

Accurate uncertainty estimation is crucial for deploying neural networks in risk-sensitive applications such as medical diagnosis. Monte Carlo Dropout is a widely used technique for approximating predictive uncertainty b…

Medical Diagnosis

Combating Noise: Semi-supervised Learning by Region Uncertainty Quantification

2021-11-01 · NeurIPS 2021 12 · Zhenyu Wang, YaLi Li, Ye Guo, Shengjin Wang

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for objec…

image-classificationImage Classificationobject-detectionObject Detection+1

Efficient Uncertainty Propagation with Guarantees in Wasserstein Distance

2025-06-10 · Eduardo Figueiredo, Steven Adams, Peyman Mohajerin Esfahani, Luca Laurenti

In this paper, we consider the problem of propagating an uncertain distribution by a possibly non-linear function and quantifying the resulting uncertainty. We measure the uncertainty using the Wasserstein distance, and …

Computational Efficiency

Quantifying Uncertainty in Stochastic Models with Parametric Variability

2015-03-04 · Kyle S. Hickmann, James M. Hyman, Sara Y. Del Valle

We present a method to quantify uncertainty in the predictions made by simulations of mathematical models that can be applied to a broad class of stochastic, discrete, and differential equation models. Quantifying uncert…

Uncertainty Quantification