Tight Prediction Intervals Using Expanded Interval Minimization
Prediction intervals are a valuable way of quantifying uncertainty in regression problems. Good prediction intervals should be both correct, containing the actual value between the lower and upper bound at least a target percentage of the time; and tight, having a small mean width of the bounds. Many prior techniques for generating prediction intervals make assumptions on the distribution of error, which causes them to work poorly for problems with asymmetric distributions. This paper presents Expanded Interval Minimization (EIM), a novel loss function for generating prediction intervals using neural networks. This loss function uses minibatch statistics to estimate the coverage and optimize the width of the prediction intervals. It does not make the same assumptions on the distributions of data and error as prior work. We compare to three published techniques and show EIM produces on average 1.37x tighter prediction intervals and in the worst case 1.06x tighter intervals across two large real-world datasets and varying coverage levels.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionPrediction IntervalsSimilar Papers 제목 키워드 기반
Relevance-Aware Thresholding in Online Conformal Prediction for Time Series
Uncertainty quantification has received considerable interest in recent works in Machine Learning. In particular, Conformal Prediction (CP) gains ground in this field. For the case of time series, Online Conformal Predic…
Lifted Coefficient of Determination: Fast model-free prediction intervals and likelihood-free model comparison
We propose the $\textit{lifted linear model}$, and derive model-free prediction intervals that become tighter as the correlation between predictions and observations increases. These intervals motivate the $\textit{Lifte…
modelOutlier DetectionPredictionPrediction Intervals+1Ensembled Prediction Intervals for Causal Outcomes Under Hidden Confounding
Causal inference of exact individual treatment outcomes in the presence of hidden confounders is rarely possible. Recent work has extended prediction intervals with finite-sample guarantees to partially identifiable caus…
Causal InferenceConformal PredictionPrediction IntervalsSensitivityRegression Conformal Prediction under Bias
Uncertainty quantification is crucial to account for the imperfect predictions of machine learning algorithms for high-impact applications. Conformal prediction (CP) is a powerful framework for uncertainty quantification…
Computed Tomography (CT)Conformal PredictionCT ReconstructionPrediction+4Interpretable Multivariate Conformal Prediction with Fast Transductive Standardization
We propose a conformal prediction method for constructing tight simultaneous prediction intervals for multiple, potentially related, numerical outputs given a single input. This method can be combined with any multi-targ…
Multi-target regression