paper-with-me

홈 › Papers

Building Conformal Prediction Intervals with Approximate Message Passing

2024-10-21 · Lucas Clarté, Lenka Zdeborová

Conformal prediction has emerged as a powerful tool for building prediction intervals that are valid in a distribution-free way. However, its evaluation may be computationally costly, especially in the high-dimensional setting where the dimensionality and sample sizes are both large and of comparable magnitudes. To address this challenge in the context of generalized linear regression, we propose a novel algorithm based on Approximate Message Passing (AMP) to accelerate the computation of prediction intervals using full conformal prediction, by approximating the computation of conformity scores. Our work bridges a gap between modern uncertainty quantification techniques and tools for high-dimensional problems involving the AMP algorithm. We evaluate our method on both synthetic and real data, and show that it produces prediction intervals that are close to the baseline methods, while being orders of magnitude faster. Additionally, in the high-dimensional limit and under assumptions on the data distribution, the conformity scores computed by AMP converge to the one computed exactly, which allows theoretical study and benchmarking of conformal methods in high dimensions.

📄 PDF Abstract BibTeX arXiv:2410.16493

Code (1)

lclarte/conformalamp.jl 공식 구현

Tasks

BenchmarkingConformal PredictionPredictionPrediction IntervalsUncertainty Quantificationvalid

Methods 이 논문이 사용한 방법론

AMP Based on the understanding that the flat local minima of the empirical risk cause the model to generalize better. Adversarial Model Perturbation (AMP) improves generalization via…

Similar Papers 제목 키워드 기반

Conformal Prediction using Conditional Histograms

2021-05-18 · NeurIPS 2021 12 · Matteo Sesia, Yaniv Romano

This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the condition…

BIG-bench Machine LearningConformal PredictionPredictionPrediction Intervals+2

Fast Conformal Prediction using Conditional Interquantile Intervals

2026-01-06 · Naixin Guo, Rui Luo, Zhixin Zhou arxiv

We introduce Conformal Interquantile Regression (CIR), a conformal regression method that efficiently constructs near-minimal prediction intervals with guaranteed coverage. CIR leverages black-box machine learning models…

Computational Efficiency

Posterior Conformal Prediction

2024-09-29 · Yao Zhang, Emmanuel J. Candès

Conformal prediction is a popular technique for constructing prediction intervals with distribution-free coverage guarantees. The coverage is marginal, meaning it only holds on average over the entire population but not …

Conformal PredictionPredictionPrediction Intervals

Bellman Conformal Inference: Calibrating Prediction Intervals For Time Series

2024-02-07 · Zitong Yang, Emmanuel Candès, Lihua Lei

We introduce Bellman Conformal Inference (BCI), a framework that wraps around any time series forecasting models and provides approximately calibrated prediction intervals. Unlike existing methods, BCI is able to leverag…

Prediction IntervalsTime SeriesTime Series Forecasting

Improved Online Conformal Prediction via Strongly Adaptive Online Learning

2023-02-15 · Aadyot Bhatnagar, Huan Wang, Caiming Xiong, Yu Bai

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that le…

Conformal Predictionimage-classificationImage ClassificationPrediction+5