Generative Zero-shot Network Quantization
Convolutional neural networks are able to learn realistic image priors from numerous training samples in low-level image generation and restoration. We show that, for high-level image recognition tasks, we can further reconstruct "realistic" images of each category by leveraging intrinsic Batch Normalization (BN) statistics without any training data. Inspired by the popular VAE/GAN methods, we regard the zero-shot optimization process of synthetic images as generative modeling to match the distribution of BN statistics. The generated images serve as a calibration set for the following zero-shot network quantizations. Our method meets the needs for quantizing models based on sensitive information, \textit{e.g.,} due to privacy concerns, no data is available. Extensive experiments on benchmark datasets show that, with the help of generated data, our approach consistently outperforms existing data-free quantization methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Data Free QuantizationImage GenerationQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models
Quantization is a promising approach for reducing memory overhead and accelerating inference, especially in large pre-trained language model (PLM) scenarios. While having no access to original training data due to securi…
Language ModelingLanguage ModellingQuantizationZero-Shot Learning of a Conditional Generative Adversarial Network for Data-Free Network Quantization
We propose a novel method for training a conditional generative adversarial network (CGAN) without the use of training data, called zero-shot learning of a CGAN (ZS-CGAN). Zero-shot learning of a conditional generator on…
Data Free QuantizationGenerative Adversarial NetworkQuantizationZero-Shot LearningZero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models
With an increasing number of Object Detection (OD) models being deployed on edge devices, Zero-Shot Quantization for OD (ZSQ-OD) aims to quantize these models when access to the original training data is prohibited. Exis…
Object DetectionLong-Range Zero-Shot Generative Deep Network Quantization
Quantization approximates a deep network model with floating-point numbers by the one with low bit width numbers, in order to accelerate inference and reduce computation. Quantizing a model without access to the original…
Knowledge DistillationQuantizationInfrared Domain Adaptation with Zero-Shot Quantization
Quantization is one of the most popular techniques for reducing computation time and shrinking model size. However, ensuring the accuracy of quantized models typically involves calibration using training data, which may …
Domain Adaptationobject-detectionObject DetectionQuantization