paper-with-me

Papers

Enhancing Adversarial Robustness with Conformal Prediction: A Framework for Guaranteed Model Reliability

2025-06-09 · Jie Bao, Chuangyin Dang, Rui Luo, Hanwei Zhang, Zhixin Zhou

As deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount. Moreover, accuracy alone does not provide sufficient assurance or reliable uncertainty estimates for these models. This study advances adversarial training by leveraging principles from Conformal Prediction. Specifically, we develop an adversarial attack method, termed OPSA (OPtimal Size Attack), designed to reduce the efficiency of conformal prediction at any significance level by maximizing model uncertainty without requiring coverage guarantees. Correspondingly, we introduce OPSA-AT (Adversarial Training), a defense strategy that integrates OPSA within a novel conformal training paradigm. Experimental evaluations demonstrate that our OPSA attack method induces greater uncertainty compared to baseline approaches for various defenses. Conversely, our OPSA-AT defensive model significantly enhances robustness not only against OPSA but also other adversarial attacks, and maintains reliable prediction. Our findings highlight the effectiveness of this integrated approach for developing trustworthy and resilient deep learning models for safety-critical domains. Our code is available at https://github.com/bjbbbb/Enhancing-Adversarial-Robustness-with-Conformal-Prediction.

📄 PDF Abstract BibTeX arXiv:2506.07804

Code (1)

bjbbbb/enhancing-adversarial-robustness-with-conformal-prediction 공식 구현 pytorch

Tasks

Adversarial AttackAdversarial RobustnessConformal PredictionPrediction

Similar Papers 제목 키워드 기반

Provably Robust Conformal Prediction with Improved Efficiency

2024-04-30 · Ge Yan, Yaniv Romano, Tsui-Wei Weng

Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that …

Conformal PredictionPrediction

Ensuring Calibration Robustness in Split Conformal Prediction Under Adversarial Attacks

2025-11-23 · Xunlei Qian, Yue Xing arxiv

Conformal prediction (CP) provides distribution-free, finite-sample coverage guarantees but critically relies on exchangeability, a condition often violated under distribution shift. We study the robustness of split conf…

The Pitfalls and Promise of Conformal Inference Under Adversarial Attacks

2024-05-14 · Ziquan Liu, Yufei Cui, Yan Yan, Yi Xu 외

In safety-critical applications such as medical imaging and autonomous driving, where decisions have profound implications for patient health and road safety, it is imperative to maintain both high adversarial robustness…

Adversarial DefenseAdversarial RobustnessAutonomous DrivingConformal Prediction+3

Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imaging

2024-11-07 · Rui Luo, Jie Bao, Zhixin Zhou, Chuangyin Dang

Adversarial attacks pose significant threats to the reliability and safety of deep learning models, especially in critical domains such as medical imaging. This paper introduces a novel framework that integrates conforma…

Adversarial RobustnessConformal PredictionPredictionUncertainty Quantification+1

Probabilistically robust conformal prediction

2023-07-31 · Subhankar Ghosh, Yuanjie Shi, Taha Belkhouja, Yan Yan 외

Conformal prediction (CP) is a framework to quantify uncertainty of machine learning classifiers including deep neural networks. Given a testing example and a trained classifier, CP produces a prediction set of candidate…

Conformal PredictionPrediction