Improving Adversarial Robustness by Enforcing Local and Global Compactness
The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges as the most successful method that consistently resists a wide range of attacks. In this work, based on an observation from a previous study that the representations of a clean data example and its adversarial examples become more divergent in higher layers of a deep neural net, we propose the Adversary Divergence Reduction Network which enforces local/global compactness and the clustering assumption over an intermediate layer of a deep neural network. We conduct comprehensive experiments to understand the isolating behavior of each component (i.e., local/global compactness and the clustering assumption) and compare our proposed model with state-of-the-art adversarial training methods. The experimental results demonstrate that augmenting adversarial training with our proposed components can further improve the robustness of the network, leading to higher unperturbed and adversarial predictive performances.
Code (1)
Tasks
Adversarial RobustnessClusteringSimilar Papers 제목 키워드 기반
Enforcing Linearity in DNN succours Robustness and Adversarial Image Generation
Recent studies on the adversarial vulnerability of neural networks have shown that models trained with the objective of minimizing an upper bound on the worst-case loss over all possible adversarial perturbations improve…
Adversarial DefenseImage GenerationRepresentation LearningCSTAR: Towards Compact and STructured Deep Neural Networks with Adversarial Robustness
Model compression and model defense for deep neural networks (DNNs) have been extensively and individually studied. Considering the co-importance of model compactness and robustness in practical applications, several pri…
Adversarial RobustnessModel CompressionContrastive-Regularized U-Net for Video Anomaly Detection
Video anomaly detection aims to identify anomalous segments in a video. It is typically trained with weakly supervised video-level labels. This paper focuses on two crucial factors affecting the performance of video anom…
Anomaly DetectionAnomaly Detection In Surveillance VideosDecoderVideo Anomaly DetectionUnsupervised Domain Adaptation for Image Classification via Structure-Conditioned Adversarial Learning
Unsupervised domain adaptation (UDA) typically carries out knowledge transfer from a label-rich source domain to an unlabeled target domain by adversarial learning. In principle, existing UDA approaches mainly focus on t…
Domain AdaptationGeneral Classificationimage-classificationImage Classification+2Improving Network Robustness against Adversarial Attacks with Compact Convolution
Though Convolutional Neural Networks (CNNs) have surpassed human-level performance on tasks such as object classification and face verification, they can easily be fooled by adversarial attacks. These attacks add a small…
Face Verification