paper-with-me

홈 › Papers

Are classical deep neural networks weakly adversarially robust?

2025-05-28 · Nuolin Sun, Linyuan Wang, Dongyang Li, Bin Yan, Lei LI

Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial defense method, adversarial training, improves the adversarial accuracy of DNNs by generating adversarial examples and retraining the model. However, adversarial training requires a significant computational overhead. In this paper, inspired by existing studies focusing on the clustering properties of DNN output features at each layer and the Progressive Feedforward Collapse phenomenon, we propose a method for adversarial example detection and image recognition that uses layer-wise features to construct feature paths and computes the correlation between the examples feature paths and the class-centered feature paths. Experimental results show that the recognition method achieves 82.77% clean accuracy and 44.17% adversarial accuracy on the ResNet-20 with PFC. Compared to the adversarial training method with 77.64% clean accuracy and 52.94% adversarial accuracy, our method exhibits a trade-off without relying on computationally expensive defense strategies. Furthermore, on the standard ResNet-18, our method maintains this advantage with respective metrics of 80.01% and 46.1%. This result reveals inherent adversarial robustness in DNNs, challenging the conventional understanding of the weak adversarial robustness in DNNs.

📄 PDF Abstract BibTeX arXiv:2506.02016

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial DefenseAdversarial Robustness

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Designing Adversarially Resilient Classifiers using Resilient Feature Engineering

2018-12-17 · Kevin Eykholt, Atul Prakash

We provide a methodology, resilient feature engineering, for creating adversarially resilient classifiers. According to existing work, adversarial attacks identify weakly correlated or non-predictive features learned by …

Feature EngineeringGeneral Classification

Adversarially-Trained Deep Nets Transfer Better: Illustration on Image Classification

2020-07-11 · ICLR 2021 1 · Francisco Utrera, Evan Kravitz, N. Benjamin Erichson, Rajiv Khanna 외

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large fea…

ClassificationGeneral Classificationimage-classificationImage Classification+1

Learning Interpretable Features via Adversarially Robust Optimization

2019-05-09 · Ashkan Khakzar, Shadi Albarqouni, Nassir Navab

Neural networks are proven to be remarkably successful for classification and diagnosis in medical applications. However, the ambiguity in the decision-making process and the interpretability of the learned features is a…

Decision Making

Improving Weakly-Supervised Object Localization Using Adversarial Erasing and Pseudo Label

2024-04-15 · Byeongkeun Kang, Sinhae Cha, Yeejin Lee

Weakly-supervised learning approaches have gained significant attention due to their ability to reduce the effort required for human annotations in training neural networks. This paper investigates a framework for weakly…

ObjectObject LocalizationPseudo LabelWeakly-supervised Learning+1

Adversarially trained LSTMs on reduced order models of urban air pollution simulations

2021-01-05 · César Quilodrán-Casas, Rossella Arcucci, Christopher Pain, Yike Guo

This paper presents an approach to improve computational fluid dynamics simulations forecasts of air pollution using deep learning. Our method, which integrates Principal Components Analysis (PCA) and adversarial trainin…