paper-with-me

Papers

HyperNetworks with statistical filtering for defending adversarial examples

2017-11-06 · Zhun Sun, Mete Ozay, Takayuki Okatani

Deep learning algorithms have been known to be vulnerable to adversarial perturbations in various tasks such as image classification. This problem was addressed by employing several defense methods for detection and rejection of particular types of attacks. However, training and manipulating networks according to particular defense schemes increases computational complexity of the learning algorithms. In this work, we propose a simple yet effective method to improve robustness of convolutional neural networks (CNNs) to adversarial attacks by using data dependent adaptive convolution kernels. To this end, we propose a new type of HyperNetwork in order to employ statistical properties of input data and features for computation of statistical adaptive maps. Then, we filter convolution weights of CNNs with the learned statistical maps to compute dynamic kernels. Thereby, weights and kernels are collectively optimized for learning of image classification models robust to adversarial attacks without employment of additional target detection and rejection algorithms. We empirically demonstrate that the proposed method enables CNNs to spontaneously defend against different types of attacks, e.g. attacks generated by Gaussian noise, fast gradient sign methods (Goodfellow et al., 2014) and a black-box attack(Narodytska & Kasiviswanathan, 2016).

📄 PDF Abstract BibTeX arXiv:1711.01791

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

HyperNetwork A HyperNetwork is a network that generates weights for a main network. The behavior of the main network is the same with any usual neural network: it learns to map some raw…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Defending against Machine Learning based Inference Attacks via Adversarial Examples: Opportunities and Challenges

2019-09-17 · Jinyuan Jia, Neil Zhenqiang Gong

As machine learning (ML) becomes more and more powerful and easily accessible, attackers increasingly leverage ML to perform automated large-scale inference attacks in various domains. In such an ML-equipped inference at…

BIG-bench Machine LearningInference Attack

Defending against Adversarial Attack towards Deep Neural Networks via Collaborative Multi-task Training

2018-03-14 · Derek Wang, Chaoran Li, Sheng Wen, Surya Nepal 외

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples which contain human-imperceptible perturbations. A series of defending methods, either proactive defence or reactive defence, have been propo…

Adversarial Attack

Parameter-Saving Adversarial Training: Reinforcing Multi-Perturbation Robustness via Hypernetworks

2023-09-28 · Huihui Gong, Minjing Dong, Siqi Ma, Seyit Camtepe 외

Adversarial training serves as one of the most popular and effective methods to defend against adversarial perturbations. However, most defense mechanisms only consider a single type of perturbation while various attack …

A Review of Adversarial Attack and Defense for Classification Methods

2021-11-18 · Yao Li, Minhao Cheng, Cho-Jui Hsieh, Thomas C. M. Lee

Despite the efficiency and scalability of machine learning systems, recent studies have demonstrated that many classification methods, especially deep neural networks (DNNs), are vulnerable to adversarial examples; i.e.,…

Adversarial AttackClassification

Towards Defending Multiple $\ell_p$-norm Bounded Adversarial Perturbations via Gated Batch Normalization

2020-12-03 · Aishan Liu, Shiyu Tang, Xinyun Chen, Lei Huang 외

There has been extensive evidence demonstrating that deep neural networks are vulnerable to adversarial examples, which motivates the development of defenses against adversarial attacks. Existing adversarial defenses typ…