Distributional conformal prediction
We propose a robust method for constructing conditionally valid prediction intervals based on models for conditional distributions such as quantile and distribution regression. Our approach can be applied to important prediction problems including cross-sectional prediction, k-step-ahead forecasts, synthetic controls and counterfactual prediction, and individual treatment effects prediction. Our method exploits the probability integral transform and relies on permuting estimated ranks. Unlike regression residuals, ranks are independent of the predictors, allowing us to construct conditionally valid prediction intervals under heteroskedasticity. We establish approximate conditional validity under consistent estimation and provide approximate unconditional validity under model misspecification, overfitting, and with time series data. We also propose a simple "shape" adjustment of our baseline method that yields optimal prediction intervals.
Code (1)
Tasks
Conformal PredictioncounterfactualPredictionPrediction IntervalsregressionTime SeriesTime Series AnalysisvalidSimilar Papers 제목 키워드 기반
Conformal online model aggregation
Conformal prediction equips machine learning models with a reasonable notion of uncertainty quantification without making strong distributional assumptions. It wraps around any black-box prediction model and converts poi…
Conformal PredictionmodelModel SelectionPrediction+1Conformalized Quantile Regression
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be un…
Conformal PredictionPredictionPrediction Intervalsquantile regression+2A Conformal Prediction Approach to Explore Functional Data
This paper applies conformal prediction techniques to compute simultaneous prediction bands and clustering trees for functional data. These tools can be used to detect outliers and clusters. Both our prediction bands and…
ClusteringConformal PredictionPredictionConformal Prediction Beyond the Horizon: Distribution-Free Inference for Policy Evaluation
Reliable uncertainty quantification is crucial for reinforcement learning (RL) in high-stakes settings. We propose a unified conformal prediction framework for infinite-horizon policy evaluation that constructs distribut…
Reinforcement LearningConformal Prediction using Conditional Histograms
This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the condition…
BIG-bench Machine LearningConformal PredictionPredictionPrediction Intervals+2