paper-with-me

Papers

SELF-KNOWLEDGE DISTILLATION ADVERSARIAL ATTACK

2019-09-25 · Ma Xiaoxiong[1], Wang Renzhi[1], Tian Cong, Dong Zeqian, Duan Zhenhua

Neural networks show great vulnerability under the threat of adversarial examples. By adding small perturbation to a clean image, neural networks with high classification accuracy can be completely fooled. One intriguing property of the adversarial examples is transferability. This property allows adversarial examples to transfer to networks of unknown structure, which is harmful even to the physical world. The current way of generating adversarial examples is mainly divided into optimization based and gradient based methods. Liu et al. (2017) conjecture that gradient based methods can hardly produce transferable targeted adversarial examples in black-box-attack. However, in this paper, we use a simple technique to improve the transferability and success rate of targeted attacks with gradient based methods. We prove that gradient based methods can also generate transferable adversarial examples in targeted attacks. Specifically, we use knowledge distillation for gradient based methods, and show that the transferability can be improved by effectively utilizing different classes of information. Unlike the usual applications of knowledge distillation, we did not train a student network to generate adversarial examples. We take advantage of the fact that knowledge distillation can soften the target and obtain higher information, and combine the soft target and hard target of the same network as the loss function. Our method is generally applicable to most gradient based attack methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackKnowledge DistillationSelf-Knowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Improving Defensive Distillation using Teacher Assistant

2023-05-14 · Maniratnam Mandal, Suna Gao

Adversarial attacks pose a significant threat to the security and safety of deep neural networks being applied to modern applications. More specifically, in computer vision-based tasks, experts can use the knowledge of m…

Face RecognitionKnowledge DistillationSelf-Driving Cars

Model Mimic Attack: Knowledge Distillation for Provably Transferable Adversarial Examples

2024-10-21 · Kirill Lukyanov, Andrew Perminov, Denis Turdakov, Mikhail Pautov

The vulnerability of artificial neural networks to adversarial perturbations in the black-box setting is widely studied in the literature. The majority of attack methods to construct these perturbations suffer from an im…

Knowledge Distillation

NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks

2023-11-01 · NeurIPS 2023 11

While multi-exit neural networks are regarded as a promising solution for making efficient inference via early exits, combating adversarial attacks remains a challenging problem. In multi-exit networks, due to the high d…

Knowledge Distillation

Improving Adversarial Robustness Through Adaptive Learning-Driven Multi-Teacher Knowledge Distillation

2025-07-28 · Hayat Ullah, Syed Muhammad Talha Zaidi, Arslan Munir arxiv

Convolutional neural networks (CNNs) excel in computer vision but are susceptible to adversarial attacks, crafted perturbations designed to mislead predictions. Despite advances in adversarial training, a gap persists be…

Adversarial RobustnessKnowledge Distillation

VIC-KD: Variance-Invariance-Covariance Knowledge Distillation to Make Keyword Spotting More Robust Against Adversarial Attacks

2023-09-22 · Heitor R. Guimarães, Arthur Pimentel, Anderson Avila, Tiago H. Falk

Keyword spotting (KWS) refers to the task of identifying a set of predefined words in audio streams. With the advances seen recently with deep neural networks, it has become a popular technology to activate and control s…

Adversarial RobustnessKeyword SpottingKnowledge DistillationModel Compression