Benchmarking Adversarial Robustness of Compressed Deep Learning Models
The increasing size of Deep Neural Networks (DNNs) poses a pressing need for model compression, particularly when employed on resource constrained devices. Concurrently, the susceptibility of DNNs to adversarial attacks presents another significant hurdle. Despite substantial research on both model compression and adversarial robustness, their joint examination remains underexplored. Our study bridges this gap, seeking to understand the effect of adversarial inputs crafted for base models on their pruned versions. To examine this relationship, we have developed a comprehensive benchmark across diverse adversarial attacks and popular DNN models. We uniquely focus on models not previously exposed to adversarial training and apply pruning schemes optimized for accuracy and performance. Our findings reveal that while the benefits of pruning enhanced generalizability, compression, and faster inference times are preserved, adversarial robustness remains comparable to the base model. This suggests that model compression while offering its unique advantages, does not undermine adversarial robustness.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessBenchmarkingDeep LearningModel CompressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial Fine-tuning of Compressed Neural Networks for Joint Improvement of Robustness and Efficiency
As deep learning (DL) models are increasingly being integrated into our everyday lives, ensuring their safety by making them robust against adversarial attacks has become increasingly critical. DL models have been found …
Adversarial RobustnessModel CompressionNetwork PruningQuantizationRobust Salient Object Detection on Compressed Images Using Convolutional Neural Networks
Salient object detection (SOD) has achieved substantial progress in recent years. In practical scenarios, compressed images (CI) serve as the primary medium for data transmission and storage. However, scant attention has…
Benchmarkingobject-detectionObject DetectionRepresentation Learning+1Generative Model Adversarial Training for Deep Compressed Sensing
Deep compressed sensing assumes the data has sparse representation in a latent space, i.e., it is intrinsically of low-dimension. The original data is assumed to be mapped from a low-dimensional space through a low-to-hi…
compressed sensingmodelIs Adversarial Training with Compressed Datasets Effective?
Dataset Condensation (DC) refers to the recent class of dataset compression methods that generate a smaller, synthetic, dataset from a larger dataset. This synthetic dataset retains the essential information of the origi…
Adversarial RobustnessDataset CondensationRobustness to distribution shifts of compressed networks for edge devices
It is necessary to develop efficient DNNs deployed on edge devices with limited computation resources. However, the compressed networks often execute new tasks in the target domain, which is different from the source dom…
Knowledge DistillationQuantization