paper-with-me

Papers

Using Single-Step Adversarial Training to Defend Iterative Adversarial Examples

2020-02-22 · Guanxiong Liu, Issa Khalil, Abdallah Khreishah

Adversarial examples have become one of the largest challenges that machine learning models, especially neural network classifiers, face. These adversarial examples break the assumption of attack-free scenario and fool state-of-the-art (SOTA) classifiers with insignificant perturbations to human. So far, researchers achieved great progress in utilizing adversarial training as a defense. However, the overwhelming computational cost degrades its applicability and little has been done to overcome this issue. Single-Step adversarial training methods have been proposed as computationally viable solutions, however they still fail to defend against iterative adversarial examples. In this work, we first experimentally analyze several different SOTA defense methods against adversarial examples. Then, based on observations from experiments, we propose a novel single-step adversarial training method which can defend against both single-step and iterative adversarial examples. Lastly, through extensive evaluations, we demonstrate that our proposed method outperforms the SOTA single-step and iterative adversarial training defense. Compared with ATDA (single-step method) on CIFAR10 dataset, our proposed method achieves 35.67% enhancement in test accuracy and 19.14% reduction in training time. When compared with methods that use BIM or Madry examples (iterative methods) on CIFAR10 dataset, it saves up to 76.03% in training time with less than 3.78% degeneration in test accuracy.

📄 PDF Abstract BibTeX arXiv:2002.09632

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Using Intuition from Empirical Properties to Simplify Adversarial Training Defense

2019-06-27 · Guanxiong Liu, Issa Khalil, Abdallah Khreishah

Due to the surprisingly good representation power of complex distributions, neural network (NN) classifiers are widely used in many tasks which include natural language processing, computer vision and cyber security. In …

Regularizers for Single-step Adversarial Training

2020-02-03 · B. S. Vivek, R. Venkatesh Babu

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of …

Efficient Robust Training via Backward Smoothing

2020-10-03 · Jinghui Chen, Yu Cheng, Zhe Gan, Quanquan Gu 외

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Rece…

Cascade Adversarial Machine Learning Regularized with a Unified Embedding

2017-08-08 · ICLR 2018 1 · Taesik Na, Jong Hwan Ko, Saibal Mukhopadhyay

Injecting adversarial examples during training, known as adversarial training, can improve robustness against one-step attacks, but not for unknown iterative attacks. To address this challenge, we first show iteratively …

BIG-bench Machine Learning

Ensemble Adversarial Training: Attacks and Defenses

2017-05-19 · ICLR 2018 1 · Florian Tramèr, Alexey Kurakin, Nicolas Papernot, Ian Goodfellow 외

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturb…