paper-with-me

홈 › Papers

Training-Free Uncertainty Estimation for Dense Regression: Sensitivity as a Surrogate

2019-09-28 · Lu Mi, Hao Wang, Yonglong Tian, Hao He, Nir Shavit

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to obtain uncertainty estimation or need significant modification (e.g., formulating a proper Bayesian treatment) to obtain it. Most previous methods are not able to take an arbitrary model off the shelf and generate uncertainty estimation without retraining or redesigning it. To address this gap, we perform a systematic exploration into training-free uncertainty estimation for dense regression, an unrecognized yet important problem, and provide a theoretical construction justifying such estimations. We propose three simple and scalable methods to analyze the variance of outputs from a trained network under tolerable perturbations: infer-transformation, infer-noise, and infer-dropout. They operate solely during the inference, without the need to re-train, re-design, or fine-tune the models, as typically required by state-of-the-art uncertainty estimation methods. Surprisingly, even without involving such perturbations in training, our methods produce comparable or even better uncertainty estimation when compared to training-required state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1910.04858

Code (0)

등록된 구현이 없습니다.

Tasks

regressionSensitivity

Similar Papers 제목 키워드 기반

Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity

2021-06-28 · ICLR 2022 4 · Shiwei Liu, Tianlong Chen, Zahra Atashgahi, Xiaohan Chen 외

The success of deep ensembles on improving predictive performance, uncertainty estimation, and out-of-distribution robustness has been extensively studied in the machine learning literature. Albeit the promising results,…

AllEnsemble LearningImage Classification

USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolution

2023-05-27 · Vikrant Rangnekar, Uddeshya Upadhyay, Zeynep Akata, Biplab Banerjee

Dense regression is a widely used approach in computer vision for tasks such as image super-resolution, enhancement, depth estimation, etc. However, the high cost of annotation and labeling makes it challenging to achiev…

Active LearningDepth EstimationImage Super-Resolutionregression+2

PIE: Performance Interval Estimation for Free-Form Generation Tasks

2025-09-09 · Chi-Yang Hsu, Alexander Braylan, Yiheng Su, Matthew Lease 외 arxiv

Confidence estimation infers a probability for whether each model output is correct or not. While predicting such binary correctness is sensible for tasks with exact answers, free-form generation tasks are often more nua…

Question AnsweringCode Generation

Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials

2024-10-27 · Matthias Holzenkamp, Dongyu Lyu, Ulrich Kleinekathöfer, Peter Zaspel

Uncertainty estimations for machine learning interatomic potentials (MLIPs) are crucial for quantifying model error and identifying informative training samples in active learning strategies. In this study, we evaluate u…

Active LearningGPR

Model-Estimation-Free, Dense, and High Dimensional Consistent Precision Matrix Estimators

2025-07-07 · Mehmet Caner Agostino Capponi Mihailo Stojnic arxiv

Precision matrix estimation is a cornerstone concept in statistics, economics, and finance. Despite advances in recent years, estimation methods that are simultaneously (i) dense, (ii) consistent, and (iii) model-free ar…