paper-with-me

홈 › Papers

Another Fit Bites the Dust: Conformal Prediction as a Calibration Standard for Machine Learning in High-Energy Physics

2025-12-18 · Jack Y. Araz, Michael Spannowsky arxiv

Machine-learning techniques are essential in modern collider research, yet their probabilistic outputs often lack calibrated uncertainty estimates and finite-sample guarantees, limiting their direct use in statistical inference and decision-making. Conformal prediction (CP) provides a simple, distribution-free framework for calibrating arbitrary predictive models without retraining, yielding rigorous uncertainty quantification with finite-sample coverage guarantees under minimal exchangeability assumptions, without reliance on asymptotics, limit theorems, or Gaussian approximations. In this work, we investigate CP as a unifying calibration layer for machine-learning applications in high-energy physics. Using publicly available collider datasets and a diverse set of models, we show that a single conformal formalism can be applied across regression, binary and multi-class classification, anomaly detection, and generative modelling, converting raw model outputs into statistically valid prediction sets, typicality regions, and p-values with controlled false-positive rates. While conformal prediction does not improve raw model performance, it enforces honest uncertainty quantification and transparent error control. We argue that conformal calibration should be adopted as a standard component of machine-learning pipelines in collider physics, enabling reliable interpretation, robust comparisons, and principled statistical decisions in experimental and phenomenological analyses.

📄 PDF Abstract BibTeX arXiv:2512.17048

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-class ClassificationAnomaly Detection

Similar Papers 제목 키워드 기반

Valid prediction intervals for regression problems

2021-07-01 · Nicolas Dewolf, Bernard De Baets, Willem Waegeman

Over the last few decades, various methods have been proposed for estimating prediction intervals in regression settings, including Bayesian methods, ensemble methods, direct interval estimation methods and conformal pre…

Conformal PredictionPredictionPrediction Intervalsregression+1

Context-Aware Online Conformal Anomaly Detection with Prediction-Powered Data Acquisition

2025-05-03 · Amirmohammad Farzaneh, Osvaldo Simeone

Online anomaly detection is essential in fields such as cybersecurity, healthcare, and industrial monitoring, where promptly identifying deviations from expected behavior can avert critical failures or security breaches.…

Anomaly Detection

Does confidence calibration improve conformal prediction?

2024-02-06 · Huajun Xi, Jianguo Huang, Kangdao Liu, Lei Feng 외

Conformal prediction is an emerging technique for uncertainty quantification that constructs prediction sets guaranteed to contain the true label with a predefined probability. Previous works often employ temperature sca…

Conformal PredictionPredictionUncertainty Quantification

Stable Localized Conformal Prediction via Transduction

2026-05-02 · Yinjie Min, Liuhua Peng, Changliang Zou arxiv

Existing evaluations of conformal prediction, such as prediction efficiency and test-conditional coverage, are defined in expectation over the calibration data. In practice, when only one calibration set of limited size …

Transfer Learning

Multi-Variable Conformal Prediction: Optimizing Prediction Sets without Data Splitting

2026-05-12 · Laura Lützow, Simone Garatti, Marco C. Campi, Lars Lindemann 외 arxiv

Conformal prediction constructs prediction sets with finite-sample coverage guarantees, but its calibration stage is structurally constrained to a scalar score function and a single threshold variable - forcing shapes of…