Adversarial Profiles: Detecting Out-Distribution & Adversarial Samples in Pre-trained CNNs
Despite high accuracy of Convolutional Neural Networks (CNNs), they are vulnerable to adversarial and out-distribution examples. There are many proposed methods that tend to detect or make CNNs robust against these fooling examples. However, most such methods need access to a wide range of fooling examples to retrain the network or to tune detection parameters. Here, we propose a method to detect adversarial and out-distribution examples against a pre-trained CNN without needing to retrain the CNN or needing access to a wide variety of fooling examples. To this end, we create adversarial profiles for each class using only one adversarial attack generation technique. We then wrap a detector around the pre-trained CNN that applies the created adversarial profile to each input and uses the output to decide whether or not the input is legitimate. Our initial evaluation of this approach using MNIST dataset show that adversarial profile based detection is effective in detecting at least 92 of out-distribution examples and 59% of adversarial examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackSimilar Papers 제목 키워드 기반
Probabilistic Modeling of Deep Features for Out-of-Distribution and Adversarial Detection
We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametri…
Adversarial AttackA Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks
Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applicatio…
class-incremental learningClass Incremental LearningIncremental LearningOut-of-Distribution DetectionA Data-Centric Approach for Improving Adversarial Training Through the Lens of Out-of-Distribution Detection
Current machine learning models achieve super-human performance in many real-world applications. Still, they are susceptible against imperceptible adversarial perturbations. The most effective solution for this problem i…
Data AugmentationOut-of-Distribution DetectionUsing Anomaly Feature Vectors for Detecting, Classifying and Warning of Outlier Adversarial Examples
We present DeClaW, a system for detecting, classifying, and warning of adversarial inputs presented to a classification neural network. In contrast to current state-of-the-art methods that, given an input, detect whether…
Adversarial AttackAdversarial Attack DetectionOut of Distribution Detection and Adversarial Attacks on Deep Neural Networks for Robust Medical Image Analysis
Deep learning models have become a popular choice for medical image analysis. However, the poor generalization performance of deep learning models limits them from being deployed in the real world as robustness is critic…
Deep LearningMedical Image AnalysisOut-of-Distribution Detection