paper-with-me

홈 › Papers

Early Stop And Adversarial Training Yield Better surrogate Model: Very Non-Robust Features Harm Adversarial Transferability

2021-09-29 · Chaoning Zhang, Gyusang Cho, Philipp Benz, Kang Zhang, Chenshuang Zhang, Chan-Hyun Youn, In So Kweon

The transferability of adversarial examples (AE); known as adversarial transferability, has attracted significant attention because it can be exploited for TransferableBlack-box Attacks (TBA). Most lines of works attribute the existence of the non-robust features improves the adversarial transferability. As a motivating example, we test the adversarial transferability on the early stopped surrogate models, which are known to be concentrated on robust features than non-robust features from prior works. We find that the early stopped models yield better adversarial transferability than the models at the final epoch, which leaves non-intuitive interpretation from the perspective of the robust and non-robust features (NRFs). In this work, we articulate a novel Very Non-Robust Feature(VNRF) hypothesis that the VNRFslearned can harm the adversarial transferability to explain this phenomenon. This hypothesis is partly verified through zeroing some filters with highl1norm values. This insight further motivates us to adopt light adversarial training that mainly removes the VNRFs for significantly improving the transferability.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Going Further: Flatness at the Rescue of Early Stopping for Adversarial Example Transferability

2023-04-05 · Martin Gubri, Maxime Cordy, Yves Le Traon

Transferability is the property of adversarial examples to be misclassified by other models than the surrogate model for which they were crafted. Previous research has shown that early stopping the training of the surrog…

Attacks Which Do Not Kill Training Make Adversarial Learning Stronger

2020-02-26 · ICML 2020 1 · Jingfeng Zhang, Xilie Xu, Bo Han, Gang Niu 외

Adversarial training based on the minimax formulation is necessary for obtaining adversarial robustness of trained models. However, it is conservative or even pessimistic so that it sometimes hurts the natural generaliza…

Adversarial Robustness

A Policy for Early Sequence Classification

2023-04-07 · Alexander Cao, Jean Utke, Diego Klabjan

Sequences are often not received in their entirety at once, but instead, received incrementally over time, element by element. Early predictions yielding a higher benefit, one aims to classify a sequence as accurately as…

Classification

Early Stopping Based on Unlabeled Samples in Text Classification

2022-05-01 · ACL 2022 5 · HongSeok Choi, Dongha Choi, Hyunju Lee

Early stopping, which is widely used to prevent overfitting, is generally based on a separate validation set. However, in low resource settings, validation-based stopping can be risky because a small validation set may n…

Classificationtext-classificationText Classification

Should I Stop or Should I Go: Early Stopping with Heterogeneous Populations

2023-09-21 · NeurIPS 2023 11

Randomized experiments often need to be stopped prematurely due to the treatment having an unintended harmful effect. Existing methods that determine when to stop an experiment early are typically applied to the data in …