paper-with-me

홈 › Papers

Multidimensional Uncertainty Quantification for Deep Neural Networks

2023-04-20 · Xujiang Zhao

Deep neural networks (DNNs) have received tremendous attention and achieved great success in various applications, such as image and video analysis, natural language processing, recommendation systems, and drug discovery. However, inherent uncertainties derived from different root causes have been realized as serious hurdles for DNNs to find robust and trustworthy solutions for real-world problems. A lack of consideration of such uncertainties may lead to unnecessary risk. For example, a self-driving autonomous car can misdetect a human on the road. A deep learning-based medical assistant may misdiagnose cancer as a benign tumor. In this work, we study how to measure different uncertainty causes for DNNs and use them to solve diverse decision-making problems more effectively. In the first part of this thesis, we develop a general learning framework to quantify multiple types of uncertainties caused by different root causes, such as vacuity (i.e., uncertainty due to a lack of evidence) and dissonance (i.e., uncertainty due to conflicting evidence), for graph neural networks. We provide a theoretical analysis of the relationships between different uncertainty types. We further demonstrate that dissonance is most effective for misclassification detection and vacuity is most effective for Out-of-Distribution (OOD) detection. In the second part of the thesis, we study the significant impact of OOD objects on semi-supervised learning (SSL) for DNNs and develop a novel framework to improve the robustness of existing SSL algorithms against OODs. In the last part of the thesis, we create a general learning framework to quantity multiple uncertainty types for multi-label temporal neural networks. We further develop novel uncertainty fusion operators to quantify the fused uncertainty of a subsequence for early event detection.

📄 PDF Abstract BibTeX arXiv:2304.10527

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDrug DiscoveryEvent DetectionOut of Distribution (OOD) DetectionRecommendation SystemsUncertainty Quantification

Similar Papers 제목 키워드 기반

Multidimensional Uncertainty Quantification via Optimal Transport

2025-09-26 · Nikita Kotelevskii, Maiya Goloburda, Vladimir Kondratyev, Alexander Fishkov 외 arxiv

Most uncertainty quantification (UQ) approaches provide a single scalar value as a measure of model reliability. However, different uncertainty measures could provide complementary information on the prediction confidenc…

Out-of-Distribution Detection

Efficient reconstruction of multidimensional random field models with heterogeneous data using stochastic neural networks

2025-11-17 · Mingtao Xia, Qijing Shen arxiv

In this paper, we analyze the scalability of a recent Wasserstein-distance approach for training stochastic neural networks (SNNs) to reconstruct multidimensional random field models. We prove a generalization error boun…

Multidimensional Distributional Neural Network Output Demonstrated in Super-Resolution of Surface Wind Speed

2025-08-21 · Harrison J. Goldwyn, Mitchell Krock, Johann Rudi, Daniel Getter 외 arxiv

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or…

Multidimensional Belief Quantification for Label-Efficient Meta-Learning

2022-03-23 · CVPR 2022 1 · Deep Pandey, Qi Yu

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quant…

Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage Classification+1

Empirical Bayes 1-bit matrix completion

2026-05-10 · Takeru Matsuda arxiv

The problem of predicting unobserved entries in a binary matrix, known as 1-bit matrix completion, has found diverse applications in fields such as recommendation systems. In this study, we develop an empirical Bayes met…

Computational EfficiencyRecommendation Systems