Exact and Robust Conformal Inference Methods for Predictive Machine Learning With Dependent Data
We extend conformal inference to general settings that allow for time series data. Our proposal is developed as a randomization method and accounts for potential serial dependence by including block structures in the permutation scheme. As a result, the proposed method retains the exact, model-free validity when the data are i.i.d. or more generally exchangeable, similar to usual conformal inference methods. When exchangeability fails, as is the case for common time series data, the proposed approach is approximately valid under weak assumptions on the conformity score.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningTime SeriesTime Series AnalysisvalidSimilar Papers 제목 키워드 기반
Exact and Approximate Conformal Inference for Multi-Output Regression
It is common in machine learning to estimate a response $y$ given covariate information $x$. However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this def…
Conformal PredictionregressionElements of Conformal Prediction for Statisticians
Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution and detailed analyses of how models learn from data. In recent years, conformal p…
Conformal inference is (almost) free for neural networks trained with early stopping
Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relat…
Multi-class ClassificationOutlier DetectionAccelerating Conformal Prediction via Approximate Leave-One-Out
While conformal prediction provides a general framework for uncertainty quantification in predictive inference, its application is often limited by computational cost. Recent methods, including Jackknife+ and Jackknife-m…
Conformal Meta-learners for Predictive Inference of Individual Treatment Effects
We investigate the problem of machine learning-based (ML) predictive inference on individual treatment effects (ITEs). Previous work has focused primarily on developing ML-based meta-learners that can provide point estim…
Conformal Predictionvalid