Clustering Effect of Adversarial Robust Models
Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but also boost the performance in some downstream tasks. However, the underlying mechanism of adversarial robustness is still not clear. In this paper, we interpret adversarial robustness from the perspective of linear components, and find that there exist some statistical properties for comprehensively robust models. Specifically, robust models show obvious hierarchical clustering effect on their linearized sub-networks, when removing or replacing all non-linear components (e.g., batch normalization, maximum pooling, or activation layers). Based on these observations, we propose a novel understanding of adversarial robustness and apply it on more tasks including domain adaption and robustness boosting. Experimental evaluations demonstrate the rationality and superiority of our proposed clustering strategy.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessClusteringDomain AdaptationSimilar Papers 제목 키워드 기반
Adversarial Learning for Robust Deep Clustering
Deep clustering integrates embedding and clustering together to obtain the optimal nonlinear embedding space, which is more effective in real-world scenarios compared with conventional clustering methods. However, the ro…
Adversarial AttackClusteringDeep ClusteringExplaining Adversarial Robustness of Neural Networks from Clustering Effect Perspective
Adversarial training (AT) is the most commonly used mechanism to improve the robustness of deep neural networks. Recently, a novel adversarial attack against intermediate layers exploits the extra fragility of advers…
Adversarial AttackAdversarial RobustnessClusteringClustering Effect of (Linearized) Adversarial Robust Models
Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but als…
Adversarial RobustnessClusteringDomain AdaptationDual Adversarial Auto-Encoders for Clustering
As a powerful approach for exploratory data analysis, unsupervised clustering is a fundamental task in computer vision and pattern recognition. Many clustering algorithms have been developed, but most of them perform uns…
ClusteringVariational InferenceProvable Defense Against Clustering Attacks on 3D Point Clouds
Lately, the literature on adversarial robustness spans from images to other domains such as point clouds. In this work, we consider clustering attacks on 3D point clouds and devise a provable defense mechanism to counter…
Adversarial RobustnessClustering