paper-with-me

홈 › Papers

Dirichlet-Based Monte Carlo Dropout for Uncertainty Estimation in Neural Networks

2026-05-22 · Rouaa Hoblos, Noura Dridi, Noureddine Zerhouni, Zeina Al Masry arxiv

Traditional neural networks provide deterministic predictions without inherent uncertainty estimates. While Bayesian Neural Networks (BNNs) offer a principled approach to uncertainty quantification, their computational complexity limits scalability. Monte Carlo (MC) Dropout, initially introduced as a regularization technique, has been shown to approximate Bayesian inference by enabling probabilistic modeling through multiple stochastic forward passes. In this work, we enhance uncertainty estimation in deep learning by integrating a Dirichlet-based framework within MC Dropout. Specifically, we leverage the formulation proposed by Sensoy et al. (2018), where class probabilities are modeled using a Dirichlet distribution, allowing for a more informative uncertainty representation. The proposed approach maintains the computational efficiency of MC Dropout while improving the quality of uncertainty estimates. We discuss the theoretical foundations of our method and compare it with existing uncertainty quantification techniques. The results highlight the effectiveness of the proposed method in producing well-calibrated uncertainty estimates, offering a practical solution for uncertainty-aware deep learning models.

📄 PDF Abstract BibTeX arXiv:2605.23635

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyBayesian Inference

Similar Papers 제목 키워드 기반

How Certain is Your Transformer?

2021-04-01 · EACL 2021 2 · Artem Shelmanov, Evgenii Tsymbalov, Dmitri Puzyrev, Kirill Fedyanin 외

In this work, we consider the problem of uncertainty estimation for Transformer-based models. We investigate the applicability of uncertainty estimates based on dropout usage at the inference stage (Monte Carlo dropout).…

Natural Language UnderstandingPoint Processes

Notes on the Behavior of MC Dropout

2020-08-06 · Francesco Verdoja, Ville Kyrki

Among the various options to estimate uncertainty in deep neural networks, Monte-Carlo dropout is widely popular for its simplicity and effectiveness. However the quality of the uncertainty estimated through this method …

Improving Predictive Uncertainty Estimation using Dropout -- Hamiltonian Monte Carlo

2018-05-12 · Diego Vergara, Sergio Hernández, Matias Valdenegro-Toro, Felipe Jorquera

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference.…

Autonomous DrivingBayesian InferenceGeneral Classificationimage-classification+1

Evaluating Prediction Uncertainty Estimates from BatchEnsemble

2026-01-29 · Morten Blørstad, Herman Jangsett Mostein, Nello Blaser, Pekka Parviainen arxiv

Deep learning models struggle with uncertainty estimation. Many approaches are either computationally infeasible or underestimate uncertainty. We investigate \textit{BatchEnsemble} as a general and scalable method for un…

Enhanced Data-Driven Product Development via Gradient Based Optimization and Conformalized Monte Carlo Dropout Uncertainty Estimation

2026-01-02 · Andrea Thomas Nava, Lijo Johny, Fabio Azzalini, Johannes Schneider 외 arxiv

Data-Driven Product Development (DDPD) leverages data to learn the relationship between product design specifications and resulting properties. To discover improved designs, we train a neural network on past experiments …