Quantized Convolutional Neural Networks for Mobile Devices
Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high computation complexity, which prohibits their further extensions. In this paper, we propose an efficient framework, namely Quantized CNN, to simultaneously speed-up the computation and reduce the storage and memory overhead of CNN models. Both filter kernels in convolutional layers and weighting matrices in fully-connected layers are quantized, aiming at minimizing the estimation error of each layer's response. Extensive experiments on the ILSVRC-12 benchmark demonstrate 4~6x speed-up and 15~20x compression with merely one percentage loss of classification accuracy. With our quantized CNN model, even mobile devices can accurately classify images within one second.
Code (1)
Tasks
General ClassificationSimilar Papers 제목 키워드 기반
Fast Implementation of 4-bit Convolutional Neural Networks for Mobile Devices
Quantized low-precision neural networks are very popular because they require less computational resources for inference and can provide high performance, which is vital for real-time and embedded recognition systems. Ho…
Optical Character Recognition (OCR)QuantizationINT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices. In this paper, we present a novel quantized Winograd optimization pipeline, which combines the …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Quantizationspeech-recognition+1Optimizing LLMs Using Quantization for Mobile Execution
Large Language Models (LLMs) offer powerful capabilities, but their significant size and computational requirements hinder deployment on resource-constrained mobile devices. This paper investigates Post-Training Quantiza…
On the Compressibility of Quantized Large Language Models
Deploying Large Language Models (LLMs) on edge or mobile devices offers significant benefits, such as enhanced data privacy and real-time processing capabilities. However, it also faces critical challenges due to the sub…
Data CompressionQuantizationRobustness Analysis of Deep Learning Frameworks on Mobile Platforms
With the recent increase in the computational power of modern mobile devices, machine learning-based heavy tasks such as face detection and speech recognition are now integral parts of such devices. This requires framewo…
BIG-bench Machine LearningDeep LearningFace DetectionQuantization+2