paper-with-me

홈 › Papers

Robust Neural Regression via Uncertainty Learning

2021-10-12 · Akib Mashrur, Wei Luo, Nayyar A. Zaidi, Antonio Robles-Kelly

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a simple solution by extending the time-tested iterative reweighted least square (IRLS) in generalised linear regression. We use two sub-networks to parametrise the prediction and uncertainty estimation, enabling easy handling of complex inputs and nonlinear response. The two sub-networks have shared representations and are trained via two complementary loss functions for the prediction and the uncertainty estimates, with interleaving steps as in a cooperative game. Compared with more complex models such as MC-Dropout or SDE-Net, our proposed network is simpler to implement and more robust (insensitive to varying aleatoric and epistemic uncertainty).

📄 PDF Abstract BibTeX arXiv:2110.06395

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Likelihood Annealing: Fast Calibrated Uncertainty for Regression

2023-02-21 · Uddeshya Upadhyay, Jae Myung Kim, Cordelia Schmidt, Bernhard Schölkopf 외

Recent advances in deep learning have shown that uncertainty estimation is becoming increasingly important in applications such as medical imaging, natural language processing, and autonomous systems. However, accurately…

DenoisingImage Super-ResolutionProperty Predictionregression+1

A framework for benchmarking uncertainty in deep regression

2021-09-10 · Franko Schmähling, Jörg Martin, Clemens Elster

We propose a framework for the assessment of uncertainty quantification in deep regression. The framework is based on regression problems where the regression function is a linear combination of nonlinear functions. Basi…

BenchmarkingregressionUncertainty Quantification

Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression

2021-03-25 · CVPR 2021 1 · Wanhua Li, Xiaoke Huang, Jiwen Lu, Jianjiang Feng 외

Uncertainty is the only certainty there is. Modeling data uncertainty is essential for regression, especially in unconstrained settings. Traditionally the direct regression formulation is considered and the uncertainty i…

Aesthetics Quality AssessmentAge And Gender ClassificationAge EstimationHistorical Color Image Dating+1

Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imaging

2021-04-26 · Max-Heinrich Laves, Sontje Ihler, Jacob F. Fast, Lüder A. Kahrs 외

The consideration of predictive uncertainty in medical imaging with deep learning is of utmost importance. We apply estimation of both aleatoric and epistemic uncertainty by variational Bayesian inference with Monte Carl…

Bayesian Inferenceregression

CRUDE: Calibrating Regression Uncertainty Distributions Empirically

2020-05-26 · Eric Zelikman, Christopher Healy, Sharon Zhou, Anand Avati

Calibrated uncertainty estimates in machine learning are crucial to many fields such as autonomous vehicles, medicine, and weather and climate forecasting. While there is extensive literature on uncertainty calibration f…

Autonomous VehiclesGeneral Classificationregression