Valid prediction intervals for regression problems
Over the last few decades, various methods have been proposed for estimating prediction intervals in regression settings, including Bayesian methods, ensemble methods, direct interval estimation methods and conformal prediction methods. An important issue is the calibration of these methods: the generated prediction intervals should have a predefined coverage level, without being overly conservative. In this work, we review the above four classes of methods from a conceptual and experimental point of view. Results on benchmark data sets from various domains highlight large fluctuations in performance from one data set to another. These observations can be attributed to the violation of certain assumptions that are inherent to some classes of methods. We illustrate how conformal prediction can be used as a general calibration procedure for methods that deliver poor results without a calibration step.
Code (1)
Tasks
Conformal PredictionPredictionPrediction IntervalsregressionvalidSimilar Papers 제목 키워드 기반
Distributional conformal prediction
We propose a robust method for constructing conditionally valid prediction intervals based on models for conditional distributions such as quantile and distribution regression. Our approach can be applied to important pr…
Conformal PredictioncounterfactualPredictionPrediction Intervals+4Conditional validity of heteroskedastic conformal regression
Conformal prediction, and split conformal prediction as a specific implementation, offer a distribution-free approach to estimating prediction intervals with statistical guarantees. Recent work has shown that split confo…
Conformal PredictionPredictionPrediction IntervalsregressionA new strategy for finite-sample valid prediction of future insurance claims in the regression setting
The extant insurance literature demonstrates a paucity of finite-sample valid prediction intervals of future insurance claims in the regression setting. To address this challenge, this article proposes a new strategy tha…
Regression Trees for Fast and Adaptive Prediction Intervals
Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions a…
PredictionPrediction IntervalsregressionvalidConformalized Quantile Regression
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be un…
Conformal PredictionPredictionPrediction Intervalsquantile regression+2