Adversarial Robustness: Softmax versus Openmax
Deep neural networks (DNNs) provide state-of-the-art results on various tasks and are widely used in real world applications. However, it was discovered that machine learning models, including the best performing DNNs, suffer from a fundamental problem: they can unexpectedly and confidently misclassify examples formed by slightly perturbing otherwise correctly recognized inputs. Various approaches have been developed for efficiently generating these so-called adversarial examples, but those mostly rely on ascending the gradient of loss. In this paper, we introduce the novel logits optimized targeting system (LOTS) to directly manipulate deep features captured at the penultimate layer. Using LOTS, we analyze and compare the adversarial robustness of DNNs using the traditional Softmax layer with Openmax, which was designed to provide open set recognition by defining classes derived from deep representations, and is claimed to be more robust to adversarial perturbations. We demonstrate that Openmax provides less vulnerable systems than Softmax to traditional attacks, however, we show that it can be equally susceptible to more sophisticated adversarial generation techniques that directly work on deep representations.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessOpen Set LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generative OpenMax for Multi-Class Open Set Classification
We present a conceptually new and flexible method for multi-class open set classification. Unlike previous methods where unknown classes are inferred with respect to the feature or decision distance to the known classes,…
ClassificationGeneral ClassificationImage Generationopen-set classificationTowards Open Set Deep Networks
Deep networks have produced significant gains for various visual recognition problems, leading to high impact academic and commercial applications. Recent work in deep networks highlighted that it is easy to generate ima…
Open Set LearningLarge-Scale Evaluation of Open-Set Image Classification Techniques
The goal for classification is to correctly assign labels to unseen samples. However, most methods misclassify samples with unseen labels and assign them to one of the known classes. Open-Set Classification (OSC) algorit…
image-classificationImage Classificationopen-set classificationOpen Set LearningDeep Learning Based Open Set Acoustic Scene Classification
In this work, we compare the performance of three selected techniques in open set acoustic scenes classification (ASC). We test thresholding of the softmax output of a deep network classifier, which is the most popular t…
Acoustic Scene ClassificationClassificationDeep LearningGeneral Classification+1Constraining Logits by Bounded Function for Adversarial Robustness
We propose a method for improving adversarial robustness by addition of a new bounded function just before softmax. Recent studies hypothesize that small logits (inputs of softmax) by logit regularization can improve adv…
Adversarial Robustness