paper-with-me

Papers

Common Knowledge Learning for Generating Transferable Adversarial Examples

2023-07-01 · Ruijie Yang, Yuanfang Guo, Junfu Wang, Jiantao Zhou, Yunhong Wang

This paper focuses on an important type of black-box attacks, i.e., transfer-based adversarial attacks, where the adversary generates adversarial examples by a substitute (source) model and utilize them to attack an unseen target model, without knowing its information. Existing methods tend to give unsatisfactory adversarial transferability when the source and target models are from different types of DNN architectures (e.g. ResNet-18 and Swin Transformer). In this paper, we observe that the above phenomenon is induced by the output inconsistency problem. To alleviate this problem while effectively utilizing the existing DNN models, we propose a common knowledge learning (CKL) framework to learn better network weights to generate adversarial examples with better transferability, under fixed network architectures. Specifically, to reduce the model-specific features and obtain better output distributions, we construct a multi-teacher framework, where the knowledge is distilled from different teacher architectures into one student network. By considering that the gradient of input is usually utilized to generated adversarial examples, we impose constraints on the gradients between the student and teacher models, to further alleviate the output inconsistency problem and enhance the adversarial transferability. Extensive experiments demonstrate that our proposed work can significantly improve the adversarial transferability.

📄 PDF Abstract BibTeX arXiv:2307.00274

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SELF-KNOWLEDGE DISTILLATION ADVERSARIAL ATTACK

2019-09-25 · Ma Xiaoxiong[1], Wang Renzhi[1], Tian Cong, Dong Zeqian 외

Neural networks show great vulnerability under the threat of adversarial examples. By adding small perturbation to a clean image, neural networks with high classification accuracy can be completely fooled. One intr…

Adversarial AttackKnowledge DistillationSelf-Knowledge Distillation

Delving into Transferable Adversarial Examples and Black-box Attacks

2016-11-08 · Yanpei Liu, Xinyun Chen, Chang Liu, Dawn Song

An intriguing property of deep neural networks is the existence of adversarial examples, which can transfer among different architectures. These transferable adversarial examples may severely hinder deep neural network-b…

Adversarial AttackAdversarial Defenseimage-classificationImage Classification

Towards Transferable Targeted Attack

2020-06-01 · CVPR 2020 6 · Maosen Li, Cheng Deng, Tengjiao Li, Junchi Yan 외

An intriguing property of adversarial examples is their transferability, which suggests that black-box attacks are feasible in real-world applications. Previous works mostly study the transferability on non-targeted sett…

Metric Learning

Structure-Preserving Transformation: Generating Diverse and Transferable Adversarial Examples

2018-09-08 · Dan Peng, Zizhan Zheng, Xiaofeng Zhang

Adversarial examples are perturbed inputs designed to fool machine learning models. Most recent works on adversarial examples for image classification focus on directly modifying pixels with minor perturbations. A common…

image-classificationImage Classification

Efficient Adversarial Training with Transferable Adversarial Examples

2019-12-27 · CVPR 2020 6 · Haizhong Zheng, Ziqi Zhang, Juncheng Gu, Honglak Lee 외

Adversarial training is an effective defense method to protect classification models against adversarial attacks. However, one limitation of this approach is that it can require orders of magnitude additional training ti…