paper-with-me

Papers

Selective Conformal Risk Control

2025-12-14 · Yunpeng Xu, Wenge Guo, Zhi Wei arxiv

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting its practical utility. To address this issue, we propose \textit{Selective Conformal Risk Control} (SCRC), a unified framework that integrates conformal prediction with selective classification. The framework formulates uncertainty control as a two-stage problem: the first stage selects confident samples for prediction, and the second stage applies conformal risk control on the selected subset to construct calibrated prediction sets. We develop two algorithms under this framework. The first, SCRC-T, preserves exchangeability by computing thresholds jointly over calibration and test samples, offering exact finite-sample guarantees. The second, SCRC-I, is a calibration-only variant that provides PAC-style probabilistic guarantees while being more computational efficient. Experiments on two public datasets show that both methods achieve the target coverage and risk levels, with nearly identical performance, while SCRC-I exhibits slightly more conservative risk control but superior computational practicality. Our results demonstrate that selective conformal risk control offers an effective and efficient path toward compact, reliable uncertainty quantification.

📄 PDF Abstract BibTeX arXiv:2512.12844

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Conformal Risk Control for Non-Monotonic Losses

2026-02-23 · Anastasios N. Angelopoulos arxiv

Conformal risk control is an extension of conformal prediction for controlling risk functions beyond miscoverage. The original algorithm controls the expected value of a loss that is monotonic in a one-dimensional parame…

Image Classification

Conformal Selective Prediction with General Risk Control

2026-03-25 · Tian Bai, Ying Jin arxiv

In deploying artificial intelligence (AI) models, selective prediction offers the option to abstain from making a prediction when uncertain about model quality. To fulfill its promise, it is crucial to enforce strict and…

Drug Discovery

Conformal Selective Acting: Anytime-Valid Risk Control for RLVR-Trained LLMs

2026-05-18 · Hamed Khosravi, Xiaoming Huo arxiv

A local specialist LLM, fine-tuned with reinforcement learning from verifiable rewards (RLVR) on operator-local data, is installed in a regulated organization with per-deployment error budget $α$. The operator needs a sa…

Reinforcement Learning

SAFE-KD: Risk-Controlled Early-Exit Distillation for Vision Backbones

2026-02-03 · Salim Khazem arxiv

Early-exit networks reduce inference cost by allowing ``easy'' inputs to stop early, but practical deployment hinges on knowing \emph{when} early exit is safe. We introduce SAFE-KD, a universal multi-exit wrapper for mod…

Knowledge Distillation

A Joint Finite-Sample Certificate for Adaptive Selective Conformal Risk Control

2026-06-07 · Xiaoli Yu, Jiamiao Liu arxiv

Selective predictors answer on confident inputs and abstain elsewhere; deploying one safely needs a single finite-sample certificate that simultaneously upper-bounds the selected risk, lower-bounds the acceptance probabi…