Visualizing Representations of Adversarially Perturbed Inputs
It has been shown that deep learning models are vulnerable to adversarial attacks. We seek to further understand the consequence of such attacks on the intermediate activations of neural networks. We present an evaluation metric, POP-N, which scores the effectiveness of projecting data to N dimensions under the context of visualizing representations of adversarially perturbed inputs. We conduct experiments on CIFAR-10 to compare the POP-2 score of several dimensionality reduction algorithms across various adversarial attacks. Finally, we utilize the 2D data corresponding to high POP-2 scores to generate example visualizations.
Code (1)
Tasks
Dimensionality ReductionSimilar Papers 제목 키워드 기반
On the Robustness of Malware Detectors to Adversarial Samples
Adversarial examples add imperceptible alterations to inputs with the objective to induce misclassification in machine learning models. They have been demonstrated to pose significant challenges in domains like image cla…
image-classificationImage ClassificationMalware AnalysisTargeted Visualization of the Backbone of Encoder LLMs
Attention based Large Language Models (LLMs) are the state-of-the-art in natural language processing (NLP). The two most common architectures are encoders such as BERT, and decoders like the GPT models. Despite the succe…
Dimensionality Reductionimage-classificationImage ClassificationStratified Adversarial Robustness with Rejection
Recently, there is an emerging interest in adversarially training a classifier with a rejection option (also known as a selective classifier) for boosting adversarial robustness. While rejection can incur a cost in many …
Adversarial RobustnessRobust classificationOn the Noise Stability and Robustness of Adversarially Trained Networks on NVM Crossbars
Applications based on Deep Neural Networks (DNNs) have grown exponentially in the past decade. To match their increasing computational needs, several Non-Volatile Memory (NVM) crossbar based accelerators have been propos…
Exploiting Safe Spots in Neural Networks for Preemptive Robustness and Out-of-Distribution Detection
Recent advances on adversarial defense mainly focus on improving the classifier’s robustness against adversarially perturbed inputs. In this paper, we turn our attention from classifiers to inputs and explore if there ex…
Adversarial DefenseOut-of-Distribution Detection