Beta quantile regression for robust estimation of uncertainty in the presence of outliers
Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as clinical diagnosis, where a realistic assessment of uncertainty is essential in determining disease status and planning the appropriate treatment. The most common application of quantile regression models is in cases where the parametric likelihood cannot be specified. Although quantile regression is quite robust to outlier response observations, it can be sensitive to outlier covariate observations (features). Outlier features can compromise the performance of deep learning regression problems such as style translation, image reconstruction, and deep anomaly detection, potentially leading to misleading conclusions. To address this problem, we propose a robust solution for quantile regression that incorporates concepts from robust divergence. We compare the performance of our proposed method with (i) least trimmed quantile regression and (ii) robust regression based on the regularization of case-specific parameters in a simple real dataset in the presence of outlier. These methods have not been applied in a deep learning framework. We also demonstrate the applicability of the proposed method by applying it to a medical imaging translation task using diffusion models.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionImage ReconstructionPrediction Intervalsquantile regressionregressionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Distribution Calibration for Regression
We are concerned with obtaining well-calibrated output distributions from regression models. Such distributions allow us to quantify the uncertainty that the model has regarding the predicted target value. We introduce t…
Gaussian ProcessesregressionUnderstanding the Under-Coverage Bias in Uncertainty Estimation
Estimating the data uncertainty in regression tasks is often done by learning a quantile function or a prediction interval of the true label conditioned on the input. It is frequently observed that quantile regression --…
parameter estimationquantile regressionregressionCanopy Tree Height Estimation Using Quantile Regression: Modeling and Evaluating Uncertainty in Remote Sensing
Accurate tree height estimation is vital for ecological monitoring and biomass assessment. We apply quantile regression to existing tree height estimation models based on satellite data to incorporate uncertainty quantif…
Nonparametric Expected Shortfall Forecasting Incorporating Weighted Quantiles
A new semi-parametric Expected Shortfall (ES) estimation and forecasting framework is proposed. The proposed approach is based on a two-step estimation procedure. The first step involves the estimation of Value-at-Risk (…
quantile regressionTime SeriesTime Series AnalysisDeep Quantile Regression for Uncertainty Estimation in Unsupervised and Supervised Lesion Detection
Despite impressive state-of-the-art performance on a wide variety of machine learning tasks, deep learning methods can produce over-confident predictions, particularly with limited training data. Therefore, quantifying u…
Anomaly DetectionLesion DetectionLesion Segmentationquantile regression+1