paper-with-me

Papers

Soft Adversarial Training Can Retain Natural Accuracy

2022-06-04 · Abhijith Sharma, Apurva Narayan

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in their deployment for real-time applications. This process initiated the need to understand the vulnerability of these models to adversarial attacks. It is instrumental in designing models that are robust against adversaries. Recent works have proposed novel techniques to counter the adversaries, most often sacrificing natural accuracy. Most suggest training with an adversarial version of the inputs, constantly moving away from the original distribution. The focus of our work is to use abstract certification to extract a subset of inputs for (hence we call it 'soft') adversarial training. We propose a training framework that can retain natural accuracy without sacrificing robustness in a constrained setting. Our framework specifically targets moderately critical applications which require a reasonable balance between robustness and accuracy. The results testify to the idea of soft adversarial training for the defense against adversarial attacks. At last, we propose the scope of future work for further improvement of this framework.

📄 PDF Abstract BibTeX arXiv:2206.01904

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Is PGD-Adversarial Training Necessary? Alternative Training via a Soft-Quantization Network with Noisy-Natural Samples Only

2018-10-10 · Tianhang Zheng, Changyou Chen, Kui Ren

Recent work on adversarial attack and defense suggests that PGD is a universal $l_\infty$ first-order attack, and PGD adversarial training can significantly improve network robustness against a wide range of first-order …

Adversarial AttackQuantization

Graph Interpolating Activation Improves Both Natural and Robust Accuracies in Data-Efficient Deep Learning

2019-07-16 · Bao Wang, Stanley J. Osher

Improving the accuracy and robustness of deep neural nets (DNNs) and adapting them to small training data are primary tasks in deep learning research. In this paper, we replace the output activation function of DNNs, typ…

Universal Adversarial Suffixes Using Calibrated Gumbel-Softmax Relaxation

2025-12-09 · Sampriti Soor, Suklav Ghosh, Arijit Sur arxiv

Language models (LMs) are often used as zero-shot or few-shot classifiers by scoring label words, but they remain fragile to adversarial prompts. Prior work typically optimizes task- or model-specific triggers, making re…

Natural Language InferenceSentiment Analysis

Revisiting Hilbert-Schmidt Information Bottleneck for Adversarial Robustness

2021-06-04 · NeurIPS 2021 12 · Zifeng Wang, Tong Jian, Aria Masoomi, Stratis Ioannidis 외

We investigate the HSIC (Hilbert-Schmidt independence criterion) bottleneck as a regularizer for learning an adversarially robust deep neural network classifier. In addition to the usual cross-entropy loss, we add regula…

Adversarial Robustness

Robust Diffusion Models for Adversarial Purification

2024-03-24 · Guang Lin, Zerui Tao, Jianhai Zhang, Toshihisa Tanaka 외

Diffusion models (DMs) based adversarial purification (AP) has shown to be the most powerful alternative to adversarial training (AT). However, these methods neglect the fact that pre-trained diffusion models themselves …

Adversarial Purification