paper-with-me

홈 › Papers

Quantized Convolutional Neural Networks for Mobile Devices

2015-12-21 · CVPR 2016 6 · Jiaxiang Wu, Cong Leng, Yuhang Wang, Qinghao Hu, Jian Cheng

Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high computation complexity, which prohibits their further extensions. In this paper, we propose an efficient framework, namely Quantized CNN, to simultaneously speed-up the computation and reduce the storage and memory overhead of CNN models. Both filter kernels in convolutional layers and weighting matrices in fully-connected layers are quantized, aiming at minimizing the estimation error of each layer's response. Extensive experiments on the ILSVRC-12 benchmark demonstrate 4~6x speed-up and 15~20x compression with merely one percentage loss of classification accuracy. With our quantized CNN model, even mobile devices can accurately classify images within one second.

📄 PDF Abstract BibTeX arXiv:1512.06473

Code (1)

jiaxiang-wu/quantized-cnn 공식 구현

Tasks

General Classification

Similar Papers 제목 키워드 기반

Fast Implementation of 4-bit Convolutional Neural Networks for Mobile Devices

2020-09-14 · Anton Trusov, Elena Limonova, Dmitry Slugin, Dmitry Nikolaev 외

Quantized low-precision neural networks are very popular because they require less computational resources for inference and can provide high performance, which is vital for real-time and embedded recognition systems. Ho…

Optical Character Recognition (OCR)Quantization

INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices

2020-10-28 · Yiwu Yao, Yuchao Li, Chengyu Wang, Tianhang Yu 외

The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices. In this paper, we present a novel quantized Winograd optimization pipeline, which combines the …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Quantizationspeech-recognition+1

Optimizing LLMs Using Quantization for Mobile Execution

2025-12-06 · Agatsya Yadav, Renta Chintala Bhargavi arxiv

Large Language Models (LLMs) offer powerful capabilities, but their significant size and computational requirements hinder deployment on resource-constrained mobile devices. This paper investigates Post-Training Quantiza…

On the Compressibility of Quantized Large Language Models

2024-03-03 · Yu Mao, Weilan Wang, Hongchao Du, Nan Guan 외

Deploying Large Language Models (LLMs) on edge or mobile devices offers significant benefits, such as enhanced data privacy and real-time processing capabilities. However, it also faces critical challenges due to the sub…

Data CompressionQuantization

Robustness Analysis of Deep Learning Frameworks on Mobile Platforms

2021-09-20 · Amin Eslami Abyane, Hadi Hemmati

With the recent increase in the computational power of modern mobile devices, machine learning-based heavy tasks such as face detection and speech recognition are now integral parts of such devices. This requires framewo…

BIG-bench Machine LearningDeep LearningFace DetectionQuantization+2