paper-with-me

Papers

C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Sets

2024-10-12 · Kangdao Liu, Hao Zeng, Jianguo Huang, Huiping Zhuang, Chi-Man Vong, Hongxin Wei

Conformal prediction, as an emerging uncertainty quantification technique, typically functions as post-hoc processing for the outputs of trained classifiers. To optimize the classifier for maximum predictive efficiency, Conformal Training rectifies the training objective with a regularization that minimizes the average prediction set size at a specific error rate. However, the regularization term inevitably deteriorates the classification accuracy and leads to suboptimal efficiency of conformal predictors. To address this issue, we introduce \textbf{Conformal Adapter} (C-Adapter), an adapter-based tuning method to enhance the efficiency of conformal predictors without sacrificing accuracy. In particular, we implement the adapter as a class of intra order-preserving functions and tune it with our proposed loss that maximizes the discriminability of non-conformity scores between correctly and randomly matched data-label pairs. Using C-Adapter, the model tends to produce extremely high non-conformity scores for incorrect labels, thereby enhancing the efficiency of prediction sets across different coverage rates. Extensive experiments demonstrate that C-Adapter can effectively adapt various classifiers for efficient prediction sets, as well as enhance the conformal training method.

📄 PDF Abstract BibTeX arXiv:2410.09408

Code (2)

codelion/adaptive-classifier pytorch
ml-stat-sustech/torchcp pytorch

Tasks

Conformal PredictionPredictionUncertainty Quantification

Methods 이 논문이 사용한 방법론

Adapter 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Learning Optimal Conformal Classifiers

2021-10-18 · ICLR 2022 4 · David Stutz, Krishnamurthy, Dvijotham, Ali Taylan Cemgil 외

Modern deep learning based classifiers show very high accuracy on test data but this does not provide sufficient guarantees for safe deployment, especially in high-stake AI applications such as medical diagnosis. Usually…

Conformal PredictionMedical Diagnosis

Test-time augmentation improves efficiency in conformal prediction

2025-05-28 · CVPR 2025 1 · Divya Shanmugam, Helen Lu, Swami Sankaranarayanan, John Guttag

A conformal classifier produces a set of predicted classes and provides a probabilistic guarantee that the set includes the true class. Unfortunately, it is often the case that conformal classifiers produce uninformative…

Conformal PredictionPrediction

Evidential Uncertainty Sets in Deep Classifiers Using Conformal Prediction

2024-06-16 · Hamed Karimi, Reza Samavi

In this paper, we propose Evidential Conformal Prediction (ECP) method for image classifiers to generate the conformal prediction sets. Our method is designed based on a non-conformity score function that has its roots i…

Conformal Prediction

Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer

2024-09-21 · Zheng Liu, Jinchao Zhu, Nannan Li, Gao Huang

Parameter-efficient transfer learning (PETL) has shown great potential in adapting a vision transformer (ViT) pre-trained on large-scale datasets to various downstream tasks. Existing studies primarily focus on minimizin…

Transfer Learning

Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification

2024-09-02 · Kangdao Liu, Tianhao Sun, Hao Zeng, Yongshan Zhang 외

Hyperspectral image (HSI) classification involves assigning unique labels to each pixel to identify various land cover categories. While deep classifiers have achieved high predictive accuracy in this field, they lack th…

ClassificationConformal PredictionHyperspectral Image Classificationimage-classification+3