Part-Based Models Improve Adversarial Robustness
We show that combining human prior knowledge with end-to-end learning can improve the robustness of deep neural networks by introducing a part-based model for object classification. We believe that the richer form of annotation helps guide neural networks to learn more robust features without requiring more samples or larger models. Our model combines a part segmentation model with a tiny classifier and is trained end-to-end to simultaneously segment objects into parts and then classify the segmented object. Empirically, our part-based models achieve both higher accuracy and higher adversarial robustness than a ResNet-50 baseline on all three datasets. For instance, the clean accuracy of our part models is up to 15 percentage points higher than the baseline's, given the same level of robustness. Our experiments indicate that these models also reduce texture bias and yield better robustness against common corruptions and spurious correlations. The code is publicly available at https://github.com/chawins/adv-part-model.
Code (1)
Tasks
Adversarial RobustnessSimilar Papers 제목 키워드 기반
On Saliency Maps and Adversarial Robustness
A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown…
Adversarial RobustnessFARMUR: Fair Adversarial Retraining to Mitigate Unfairness in Robustness
Deep Neural Networks (DNNs) have been deployed in safetycritical real-world applications, including automated decision-making systems. There are often concerns about two aspects of these systems: the fairness of the pred…
Decision MakingFairnessExploring Model Robustness with Adaptive Networks and Improved Adversarial Training
Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build mor…
AugRmixAT: A Data Processing and Training Method for Improving Multiple Robustness and Generalization Performance
Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network …
Adversarial RobustnessAdversarial training may be a double-edged sword
Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, w…