Impact of Scaled Image on Robustness of Deep Neural Networks
Deep neural networks (DNNs) have been widely used in computer vision tasks like image classification, object detection and segmentation. Whereas recent studies have shown their vulnerability to manual digital perturbations or distortion in the input images. The accuracy of the networks is remarkably influenced by the data distribution of their training dataset. Scaling the raw images creates out-of-distribution data, which makes it a possible adversarial attack to fool the networks. In this work, we propose a Scaling-distortion dataset ImageNet-CS by Scaling a subset of the ImageNet Challenge dataset by different multiples. The aim of our work is to study the impact of scaled images on the performance of advanced DNNs. We perform experiments on several state-of-the-art deep neural network architectures on the proposed ImageNet-CS, and the results show a significant positive correlation between scaling size and accuracy decline. Moreover, based on ResNet50 architecture, we demonstrate some tests on the performance of recent proposed robust training techniques and strategies like Augmix, Revisiting and Normalizer Free on our proposed ImageNet-CS. Experiment results have shown that these robust training techniques can improve networks' robustness to scaling transformation.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial Attackimage-classificationImage Classificationobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Loop Shaping with Scaled Relative Graphs
The Scaled Relative Graph (SRG) is a generalization of the Nyquist diagram that may be plotted for nonlinear operators, and allows nonlinear robustness margins to be defined graphically. This abstract explores techniques…
TSPTQ-ViT: Two-scaled post-training quantization for vision transformer
Vision transformers (ViTs) have achieved remarkable performance in various computer vision tasks. However, intensive memory and computation requirements impede ViTs from running on resource-constrained edge devices. Due …
QuantizationStochastic Gradient Methods with Preconditioned Updates
This work considers the non-convex finite sum minimization problem. There are several algorithms for such problems, but existing methods often work poorly when the problem is badly scaled and/or ill-conditioned, and a pr…
Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Image
Thermal infrared (TIR) cameras are emerging as promising sensors in safety-related fields due to their robustness against external illumination. However, RAW TIR image has 14 bits of pixel depth and needs to be rescaled …
Image Quality AssessmentDownscaled Representation Matters: Improving Image Rescaling with Collaborative Downscaled Images
Deep networks have achieved great success in image rescaling (IR) task that seeks to learn the optimal downscaled representations, i.e., low-resolution (LR) images, to reconstruct the original high-resolution (HR) images…
Image ReconstructionImage RescalingSuper-Resolution