paper-with-me

홈 › Papers

Saliency Diversified Deep Ensemble for Robustness to Adversaries

2021-12-07 · AAAI Workshop AdvML 2022 2 · Alex Bogun, Dimche Kostadinov, Damian Borth

Deep learning models have shown incredible performance on numerous image recognition, classification, and reconstruction tasks. Although very appealing and valuable due to their predictive capabilities, one common threat remains challenging to resolve. A specifically trained attacker can introduce malicious input perturbations to fool the network, thus causing potentially harmful mispredictions. Moreover, these attacks can succeed when the adversary has full access to the target model (white-box) and even when such access is limited (black-box setting). The ensemble of models can protect against such attacks but might be brittle under shared vulnerabilities in its members (attack transferability). To that end, this work proposes a novel diversity-promoting learning approach for the deep ensembles. The idea is to promote saliency map diversity (SMD) on ensemble members to prevent the attacker from targeting all ensemble members at once by introducing an additional term in our learning objective. During training, this helps us minimize the alignment between model saliencies to reduce shared member vulnerabilities and, thus, increase ensemble robustness to adversaries. We empirically show a reduced transferability between ensemble members and improved performance compared to the state-of-the-art ensemble defense against medium and high strength white-box attacks. In addition, we demonstrate that our approach combined with existing methods outperforms state-of-the-art ensemble algorithms for defense under white-box and black-box attacks.

📄 PDF Abstract BibTeX arXiv:2112.03615

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Similar Papers 제목 키워드 기반

Diversifying Deep Ensembles: A Saliency Map Approach for Enhanced OOD Detection, Calibration, and Accuracy

2023-05-19 · Stanislav Dereka, Ivan Karpukhin, Maksim Zhdanov, Sergey Kolesnikov

Deep ensembles are capable of achieving state-of-the-art results in classification and out-of-distribution (OOD) detection. However, their effectiveness is limited due to the homogeneity of learned patterns within ensemb…

ClassificationDiversityOut of Distribution (OOD) Detection

On Saliency Maps and Adversarial Robustness

2020-06-14 · Puneet Mangla, Vedant Singh, Vineeth N. Balasubramanian

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown…

Adversarial Robustness

Evaluating Ensemble Robustness Against Adversarial Attacks

2020-05-12 · George Adam, Romain Speciel

Adversarial examples, which are slightly perturbed inputs generated with the aim of fooling a neural network, are known to transfer between models; adversaries which are effective on one model will often fool another. Th…

Toward Adversarial Robustness by Diversity in an Ensemble of Specialized Deep Neural Networks

2020-05-17 · Mahdieh Abbasi, Arezoo Rajabi, Christian Gagne, Rakesh B. Bobba

We aim at demonstrating the influence of diversity in the ensemble of CNNs on the detection of black-box adversarial instances and hardening the generation of white-box adversarial attacks. To this end, we propose an ens…

Adversarial RobustnessDiversity

Detecting Adversarial Perturbations with Saliency

2018-03-23 · Chiliang Zhang, Zhimou Yang, Zuochang Ye

In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how t…

ClassificationGeneral Classificationimage-classificationImage Classification