paper-with-me

Papers

Robustness of Bayesian Neural Networks to White-Box Adversarial Attacks

2021-11-16 · Adaku Uchendu, Daniel Campoy, Christopher Menart, Alexandra Hildenbrandt

Bayesian Neural Networks (BNNs), unlike Traditional Neural Networks (TNNs) are robust and adept at handling adversarial attacks by incorporating randomness. This randomness improves the estimation of uncertainty, a feature lacking in TNNs. Thus, we investigate the robustness of BNNs to white-box attacks using multiple Bayesian neural architectures. Furthermore, we create our BNN model, called BNN-DenseNet, by fusing Bayesian inference (i.e., variational Bayes) to the DenseNet architecture, and BDAV, by combining this intervention with adversarial training. Experiments are conducted on the CIFAR-10 and FGVC-Aircraft datasets. We attack our models with strong white-box attacks ($l_\infty$-FGSM, $l_\infty$-PGD, $l_2$-PGD, EOT $l_\infty$-FGSM, and EOT $l_\infty$-PGD). In all experiments, at least one BNN outperforms traditional neural networks during adversarial attack scenarios. An adversarially-trained BNN outperforms its non-Bayesian, adversarially-trained counterpart in most experiments, and often by significant margins. Lastly, we investigate network calibration and find that BNNs do not make overconfident predictions, providing evidence that BNNs are also better at measuring uncertainty.

📄 PDF Abstract BibTeX arXiv:2111.08591

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackBayesian Inference

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Batch Normalization 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dense Block A Dense Block is a module used in convolutional neural networks that connects *all layers* (with matching feature-map sizes) directly with each other. It was originally…
Kaiming Initialization 설명 없음

Similar Papers 제목 키워드 기반

Adversarial training may be a double-edged sword

2021-07-24 · Ali Rahmati, Seyed-Mohsen Moosavi-Dezfooli, Huaiyu Dai

Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, w…

Stochastic Local Winner-Takes-All Networks Enable Profound Adversarial Robustness

2021-12-05 · Konstantinos P. Panousis, Sotirios Chatzis, Sergios Theodoridis

This work explores the potency of stochastic competition-based activations, namely Stochastic Local Winner-Takes-All (LWTA), against powerful (gradient-based) white-box and black-box adversarial attacks; we especially fo…

Adversarial AttackAdversarial DefenseAdversarial RobustnessAll+1

Model Robustness with Text Classification: Semantic-preserving adversarial attacks

2020-08-12 · Rahul Singh, Tarun Joshi, Vijayan N. Nair, Agus Sudjianto

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the sem…

Adversarial AttackClassificationGeneral Classificationtext-classification+1

Two Sides of the Same Coin: White-box and Black-box Attacks for Transfer Learning

2020-08-25 · Yinghua Zhang, Yangqiu Song, Jian Liang, Kun Bai 외

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learnin…

Transfer Learning

On the exploitative behavior of adversarial training against adversarial attacks

2021-09-29 · Ali Rahmati, Seyed-Mohsen Moosavi-Dezfooli, Huaiyu Dai

Adversarial attacks have been developed as intentionally designed perturbations added to the inputs in order to fool deep neural network classifiers. Adversarial training has been shown to be an effective approach to imp…