LANCE: Efficient Low-Precision Quantized Winograd Convolution for Neural Networks Based on Graphics Processing Units
Accelerating deep convolutional neural networks has become an active topic and sparked an interest in academia and industry. In this paper, we propose an efficient low-precision quantized Winograd convolution algorithm, called LANCE, which combines the advantages of fast convolution and quantization techniques. By embedding linear quantization operations into the Winograd-domain, the fast convolution can be performed efficiently under low-precision computation on graphics processing units. We test neural network models with LANCE on representative image classification datasets, including SVHN, CIFAR, and ImageNet. The experimental results show that our 8-bit quantized Winograd convolution improves the performance by up to 2.40x over the full-precision convolution with trivial accuracy loss.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Channel Balancing for Accurate Quantization of Winograd Convolutions
It is well known that Winograd convolution algorithms speed up the widely used small-size convolutions. However, the problem of quantization of Winograd convolutions is challenging - while quantization of slower Wino…
QuantizationData-Free Group-Wise Fully Quantized Winograd Convolution via Learnable Scales
Despite the revolutionary breakthroughs of large-scale text-to-image diffusion models for complex vision and downstream tasks, their extremely high computational and storage costs limit their usability. Quantization of d…
image-classificationImage ClassificationImage GenerationQuantization+2Quantaized Winograd/Toom-Cook Convolution for DNNs: Beyond Canonical Polynomials Base
The problem how to speed up the convolution computations in Deep Neural Networks is widely investigated in recent years. The Winograd convolution algorithm is a common used method that significantly reduces time consumpt…
Efficient Residue Number System Based Winograd Convolution
Prior research has shown that Winograd algorithm can reduce the computational complexity of convolutional neural networks (CNN) with weights and activations represented in floating point. However it is difficult to apply…
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices. In this paper, we present a novel quantized Winograd optimization pipeline, which combines the …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Quantizationspeech-recognition+1