Probabilistic Conformal Prediction Using Conditional Random Samples
This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from an estimated generative model. It is efficient and compatible with either explicit or implicit conditional generative models. Theoretically, we show that PCP guarantees correct marginal coverage with finite samples. Empirically, we study PCP on a variety of simulated and real datasets. Compared to existing methods for conformal inference, PCP provides sharper predictive sets.
Code (1)
Tasks
Conformal PredictionPredictionPrediction IntervalsSimilar Papers 제목 키워드 기반
Criteria of efficiency for conformal prediction
We study optimal conformity measures for various criteria of efficiency of classification in an idealised setting. This leads to an important class of criteria of efficiency that we call probabilistic; it turns out that …
ClassificationConformal PredictionGeneral ClassificationPredictionProbabilistic Conformal Prediction with Approximate Conditional Validity
We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile …
Conformal PredictionPredictionquantile regressionvalidConformalised Conditional Normalising Flows for Joint Prediction Regions in time series
Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-…
Conformal PredictionNormalising FlowsPredictionTime Series+1Probabilistic Conformal Coverage Guarantees in Small-Data Settings
Conformal prediction provides distribution-free prediction sets with guaranteed marginal coverage. However, in split conformal prediction this guarantee is training-conditional only in expectation: across many calibratio…
Conformal Predictive Programming for Chance Constrained Optimization
We propose conformal predictive programming (CPP), a framework to solve chance constrained optimization problems, i.e., optimization problems with constraints that are functions of random variables. CPP utilizes samples …
Bilevel OptimizationConformal PredictionLEMMA