paper-with-me

Papers

Effect of Data Augmentation on Conformal Prediction for Diabetic Retinopathy

2025-08-19 · Rizwan Ahamed, Annahita Amireskandari, Joel Palko, Carol Laxson, Binod Bhattarai, Prashnna Gyawali arxiv

The clinical deployment of deep learning models for high-stakes tasks such as diabetic retinopathy (DR) grading requires demonstrable reliability. While models achieve high accuracy, their clinical utility is limited by a lack of robust uncertainty quantification. Conformal prediction (CP) offers a distribution-free framework to generate prediction sets with statistical guarantees of coverage. However, the interaction between standard training practices like data augmentation and the validity of these guarantees is not well understood. In this study, we systematically investigate how different data augmentation strategies affect the performance of conformal predictors for DR grading. Using the DDR dataset, we evaluate two backbone architectures -- ResNet-50 and a Co-Scale Conv-Attentional Transformer (CoaT) -- trained under five augmentation regimes: no augmentation, standard geometric transforms, CLAHE, Mixup, and CutMix. We analyze the downstream effects on conformal metrics, including empirical coverage, average prediction set size, and correct efficiency. Our results demonstrate that sample-mixing strategies like Mixup and CutMix not only improve predictive accuracy but also yield more reliable and efficient uncertainty estimates. Conversely, methods like CLAHE can negatively impact model certainty. These findings highlight the need to co-design augmentation strategies with downstream uncertainty quantification in mind to build genuinely trustworthy AI systems for medical imaging.

📄 PDF Abstract BibTeX arXiv:2508.14266

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Conformal Risk Control for Ordinal Classification

2024-05-01 · Yunpeng Xu, Wenge Guo, Zhi Wei

As a natural extension to the standard conformal prediction method, several conformal risk control methods have been recently developed and applied to various learning problems. In this work, we seek to control the confo…

ClassificationConformal PredictionDiabetic Retinopathy DetectionOrdinal Classification

Test-time augmentation improves efficiency in conformal prediction

2025-05-28 · CVPR 2025 1 · Divya Shanmugam, Helen Lu, Swami Sankaranarayanan, John Guttag

A conformal classifier produces a set of predicted classes and provides a probabilistic guarantee that the set includes the true class. Unfortunately, it is often the case that conformal classifiers produce uninformative…

Conformal PredictionPrediction

Filtering with Confidence: When Data Augmentation Meets Conformal Prediction

2025-09-25 · Zixuan Wu, So Won Jeong, Yating Liu, Yeo Jin Jung 외 arxiv

With promising empirical performance across a wide range of applications, synthetic data augmentation appears a viable solution to data scarcity and the demands of increasingly data-intensive models. Its effectiveness li…

Image ClassificationSentiment AnalysisData AugmentationFraud Detection

CPSC: Conformal prediction with shrunken centroids for efficient prediction reliability quantification and data augmentation, a case in alternative herbal medicine classification with electronic nose

2021-08-02 · Li Liu, Xianghao Zhan, Xikai Yang, Xiaoqing Guan 외

In machine learning applications, the reliability of predictions is significant for assisted decision and risk control. As an effective framework to quantify the prediction reliability, conformal prediction (CP) was deve…

Conformal PredictionData AugmentationPrediction

An Uncertainty-Aware Pseudo-Label Selection Framework using Regularized Conformal Prediction

2023-08-30 · Matin Moezzi

Consistency regularization-based methods are prevalent in semi-supervised learning (SSL) algorithms due to their exceptional performance. However, they mainly depend on domain-specific data augmentations, which are not u…

Conformal PredictionPseudo Label