paper-with-me

홈 › Papers

Towards Bridging the gap between Empirical and Certified Robustness against Adversarial Examples

2021-02-09 · Jay Nandy, Sudipan Saha, Wynne Hsu, Mong Li Lee, Xiao Xiang Zhu

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense against adversarial examples without providing any robustness guarantees for large classifiers or higher-dimensional inputs. In contrast, existing randomized smoothing based models achieve state-of-the-art certified robustness while significantly degrading the empirical robustness against adversarial examples. In this paper, we propose a novel method, called \emph{Certification through Adaptation}, that transforms an AT model into a randomized smoothing classifier during inference to provide certified robustness for $\ell_2$ norm without affecting their empirical robustness against adversarial attacks. We also propose \emph{Auto-Noise} technique that efficiently approximates the appropriate noise levels to flexibly certify the test examples using randomized smoothing technique. Our proposed \emph{Certification through Adaptation} with \emph{Auto-Noise} technique achieves an \textit{average certified radius (ACR) scores} up to $1.102$ and $1.148$ respectively for CIFAR-10 and ImageNet datasets using AT models without affecting their empirical robustness or benign accuracy. Therefore, our paper is a step towards bridging the gap between the empirical and certified robustness against adversarial examples by achieving both using the same classifier.

📄 PDF Abstract BibTeX arXiv:2102.05096

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Methods 이 논문이 사용한 방법론

Randomized Smoothing 설명 없음
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregation

2022-02-05 · Wenxiao Wang, Alexander Levine, Soheil Feizi

Data poisoning attacks aim at manipulating model behaviors through distorting training data. Previously, an aggregation-based certified defense, Deep Partition Aggregation (DPA), was proposed to mitigate this threat. DPA…

Data Poisoning

Bridging the Theoretical Gap in Randomized Smoothing

2025-04-03 · Blaise Delattre, Paul Caillon, Quentin Barthélemy, Erwan Fagnou 외

Randomized smoothing has become a leading approach for certifying adversarial robustness in machine learning models. However, a persistent gap remains between theoretical certified robustness and empirical robustness acc…

Adversarial Robustness

On Using Certified Training towards Empirical Robustness

2024-10-02 · Alessandro De Palma, Serge Durand, Zakaria Chihani, François Terrier 외

Adversarial training is arguably the most popular way to provide empirical robustness against specific adversarial examples. While variants based on multi-step attacks incur significant computational overhead, single-ste…

Unraveling the Connections between Privacy and Certified Robustness in Federated Learning Against Poisoning Attacks

2022-09-08 · Chulin Xie, Yunhui Long, Pin-Yu Chen, Qinbin Li 외

Federated learning (FL) provides an efficient paradigm to jointly train a global model leveraging data from distributed users. As local training data comes from different users who may not be trustworthy, several studies…

Federated Learning

Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks

2023-07-31 · Xinyu Zhang, Hanbin Hong, Yuan Hong, Peng Huang 외

The language models, especially the basic text classification models, have been shown to be susceptible to textual adversarial attacks such as synonym substitution and word insertion attacks. To defend against such attac…

text-classificationText Classification