Universal Adversarial Robustness of Texture and Shape-Biased Models
Increasing shape-bias in deep neural networks has been shown to improve robustness to common corruptions and noise. In this paper we analyze the adversarial robustness of texture and shape-biased models to Universal Adversarial Perturbations (UAPs). We use UAPs to evaluate the robustness of DNN models with varying degrees of shape-based training. We find that shape-biased models do not markedly improve adversarial robustness, and we show that ensembles of texture and shape-biased models can improve universal adversarial robustness while maintaining strong performance.
Code (1)
Tasks
Adversarial RobustnessImage ClassificationSimilar Papers 제목 키워드 기반
Shape-Texture Debiased Neural Network Training
Shape and texture are two prominent and complementary cues for recognizing objects. Nonetheless, Convolutional Neural Networks are often biased towards either texture or shape, depending on the training dataset. Our abla…
Adversarial RobustnessData AugmentationImage ClassificationRepresentation LearningInBiaseD: Inductive Bias Distillation to Improve Generalization and Robustness through Shape-awareness
Humans rely less on spurious correlations and trivial cues, such as texture, compared to deep neural networks which lead to better generalization and robustness. It can be attributed to the prior knowledge or the high-le…
Inductive BiasInformative Dropout for Robust Representation Learning: A Shape-bias Perspective
Convolutional Neural Networks (CNNs) are known to rely more on local texture rather than global shape when making decisions. Recent work also indicates a close relationship between CNN's texture-bias and its robustness a…
Domain GeneralizationRepresentation LearningRobustness properties of Facebook's ResNeXt WSL models
We investigate the robustness properties of ResNeXt class image recognition models trained with billion scale weakly supervised data (ResNeXt WSL models). These models, recently made public by Facebook AI, were trained w…
Adversarial RobustnessStyleAugment: Learning Texture De-biased Representations by Style Augmentation without Pre-defined Textures
Recent powerful vision classifiers are biased towards textures, while shape information is overlooked by the models. A simple attempt by augmenting training images using the artistic style transfer method, called Stylize…
Data AugmentationDiversityStyle Transfer