paper-with-me

Papers

Multi-level Monte Carlo Dropout for Efficient Uncertainty Quantification

2026-01-19 · Aaron Pim, Tristan Pryer arxiv

We develop a multilevel Monte Carlo (MLMC) framework for uncertainty quantification with Monte Carlo dropout. Treating dropout masks as a source of epistemic randomness, we define a fidelity hierarchy by the number of stochastic forward passes used to estimate predictive moments. We construct coupled coarse--fine estimators by reusing dropout masks across fidelities, yielding telescoping MLMC estimators for both predictive means and predictive variances that remain unbiased for the corresponding dropout-induced quantities while reducing sampling variance at fixed evaluation budget. We derive explicit bias, variance and effective cost expressions, together with sample-allocation rules across levels. Numerical experiments on forward and inverse PINNs--Uzawa benchmarks confirm the predicted variance rates and demonstrate efficiency gains over single-level MC-dropout at matched cost.

📄 PDF Abstract BibTeX arXiv:2601.13272

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Fast Monte Carlo Dropout and Error Correction for Radio Transmitter Classification

2020-01-31 · Liangping Ma, John Kaewell

Monte Carlo dropout may effectively capture model uncertainty in deep learning, where a measure of uncertainty is obtained by using multiple instances of dropout at test time. However, Monte Carlo dropout is applied acro…

General Classification

Enhanced Data-Driven Product Development via Gradient Based Optimization and Conformalized Monte Carlo Dropout Uncertainty Estimation

2026-01-02 · Andrea Thomas Nava, Lijo Johny, Fabio Azzalini, Johannes Schneider 외 arxiv

Data-Driven Product Development (DDPD) leverages data to learn the relationship between product design specifications and resulting properties. To discover improved designs, we train a neural network on past experiments …

Qualitative Analysis of Monte Carlo Dropout

2020-07-03 · Ronald Seoh

In this report, we present qualitative analysis of Monte Carlo (MC) dropout method for measuring model uncertainty in neural network (NN) models. We first consider the sources of uncertainty in NNs, and briefly review Ba…

How Certain is Your Transformer?

2021-04-01 · EACL 2021 2 · Artem Shelmanov, Evgenii Tsymbalov, Dmitri Puzyrev, Kirill Fedyanin 외

In this work, we consider the problem of uncertainty estimation for Transformer-based models. We investigate the applicability of uncertainty estimates based on dropout usage at the inference stage (Monte Carlo dropout).…

Natural Language UnderstandingPoint Processes

Notes on the Behavior of MC Dropout

2020-08-06 · Francesco Verdoja, Ville Kyrki

Among the various options to estimate uncertainty in deep neural networks, Monte-Carlo dropout is widely popular for its simplicity and effectiveness. However the quality of the uncertainty estimated through this method …