paper-with-me

Papers

Deep Quantile Regression for Uncertainty Estimation in Unsupervised and Supervised Lesion Detection

2021-09-20 · Haleh Akrami, Anand Joshi, Sergul Aydore, Richard Leahy

Despite impressive state-of-the-art performance on a wide variety of machine learning tasks, deep learning methods can produce over-confident predictions, particularly with limited training data. Therefore, quantifying uncertainty is particularly important in critical applications such as lesion detection and clinical diagnosis, where a realistic assessment of uncertainty is essential in determining surgical margins, disease status and appropriate treatment. In this work, we propose a novel approach that uses quantile regression for quantifying aleatoric uncertainty in both supervised and unsupervised lesion detection problems. The resulting confidence intervals can be used for lesion detection and segmentation. In the unsupervised setting, we combine quantile regression with the Variational AutoEncoder (VAE). Here we address the problem of quantifying uncertainty in the images that are reconstructed by the VAE as the basis for principled outlier or lesion detection. The VAE models the output as a conditionally independent Gaussian characterized by its mean and variance. Unfortunately, joint optimization of both mean and variance in the VAE leads to the well-known problem of shrinkage or underestimation of variance. Here we describe an alternative Quantile-Regression VAE (QR-VAE) that avoids this variance shrinkage problem by directly estimating conditional quantiles for the input image. Using the estimated quantiles, we compute the conditional mean and variance for the input image from which we then detect outliers by thresholding at a false-discovery-rate corrected p-value. In the supervised setting, we develop binary quantile regression (BQR) for the supervised lesion segmentation task. We show how BQR can be used to capture uncertainty in lesion boundaries in a manner that characterizes expert disagreement.

📄 PDF Abstract BibTeX arXiv:2109.09374

Code (1)

ajoshiusc/qrvae 공식 구현 pytorch

Tasks

Anomaly DetectionLesion DetectionLesion Segmentationquantile regressionregression

Similar Papers 제목 키워드 기반

SEMF: Supervised Expectation-Maximization Framework for Predicting Intervals

2024-05-28 · Ilia Azizi, Marc-Olivier Boldi, Valérie Chavez-Demoulin

This work introduces the Supervised Expectation-Maximization Framework (SEMF), a versatile and model-agnostic approach for generating prediction intervals with any ML model. SEMF extends the Expectation-Maximization algo…

PredictionPrediction Intervalsquantile regressionregression+1

Understanding the Under-Coverage Bias in Uncertainty Estimation

2021-06-10 · NeurIPS 2021 12 · Yu Bai, Song Mei, Huan Wang, Caiming Xiong

Estimating the data uncertainty in regression tasks is often done by learning a quantile function or a prediction interval of the true label conditioned on the input. It is frequently observed that quantile regression --…

parameter estimationquantile regressionregression

Canopy Tree Height Estimation Using Quantile Regression: Modeling and Evaluating Uncertainty in Remote Sensing

2026-04-08 · Karsten Schrödter, Jan Pauls, Fabian Gieseke arxiv

Accurate tree height estimation is vital for ecological monitoring and biomass assessment. We apply quantile regression to existing tree height estimation models based on satellite data to incorporate uncertainty quantif…

Physics-Informed Deep Monte Carlo Quantile Regression method for Interval Multilevel Bayesian Network-based Satellite Heat Reliability Analysis

2022-02-14 · Xiaohu Zheng, Wen Yao, Zhiqiang Gong, Yunyang Zhang 외

Temperature field reconstruction is essential for analyzing satellite heat reliability. As a representative machine learning model, the deep convolutional neural network (DCNN) is a powerful tool for reconstructing the s…

quantile regressionregression

Beta quantile regression for robust estimation of uncertainty in the presence of outliers

2023-09-14 · Haleh Akrami, Omar Zamzam, Anand Joshi, Sergul Aydore 외

Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as cli…

Anomaly DetectionImage ReconstructionPrediction Intervalsquantile regression+2