Exchangeability, Conformal Prediction, and Rank Tests
Conformal prediction has been a very popular method of distribution-free predictive inference in recent years in machine learning and statistics. Its popularity stems from the fact that it works as a wrapper around any prediction algorithm such as neural networks or random forests. Exchangeability is at the core of the validity of conformal prediction. The concept of exchangeability is also at the core of rank tests widely known in nonparametric statistics. In this paper, we review the concept of exchangeability and discuss the implications for conformal prediction and rank tests. We provide a low-level introduction to these topics, and discuss the similarities between conformal prediction and rank tests.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningConformal PredictionDimensionality ReductionPredictionSimilar Papers 제목 키워드 기반
E-Values Expand the Scope of Conformal Prediction
Conformal prediction is a powerful framework for distribution-free uncertainty quantification. The standard approach to conformal prediction relies on comparing the ranks of prediction scores: under exchangeability, the …
Conformal PredictionPredictionUncertainty QuantificationvalidRandomness, exchangeability, and conformal prediction
This paper argues for a wider use of the functional theory of randomness, a modification of the algorithmic theory of randomness getting rid of unspecified additive constants. Both theories are useful for understanding r…
Conformal PredictionPredictionTranslationvalidConformal time series decomposition with component-wise exchangeability
Conformal prediction offers a practical framework for distribution-free uncertainty quantification, providing finite-sample coverage guarantees under relatively mild assumptions on data exchangeability. However, these as…
Conformal PredictionPredictionPrediction IntervalsTime Series+2Extending Conformal Prediction to Hidden Markov Models with Exact Validity via de Finetti's Theorem for Markov Chains
Conformal prediction is a widely used method to quantify the uncertainty of a classifier under the assumption of exchangeability (e.g., IID data). We generalize conformal prediction to the Hidden Markov Model (HMM) frame…
Conformal PredictionPredictionvalidSConU: Selective Conformal Uncertainty in Large Language Models
As large language models are increasingly utilized in real-world applications, guarantees of task-specific metrics are essential for their reliable deployment. Previous studies have introduced various criteria of conform…
Conformal PredictionQuestion Answering