AQD: Towards Accurate Fully-Quantized Object Detection
Network quantization allows inference to be conducted using low-precision arithmetic for improved inference efficiency of deep neural networks on edge devices. However, designing aggressively low-bit (e.g., 2-bit) quantization schemes on complex tasks, such as object detection, still remains challenging in terms of severe performance degradation and unverifiable efficiency on common hardware. In this paper, we propose an Accurate Quantized object Detection solution, termed AQD, to fully get rid of floating-point computation. To this end, we target using fixed-point operations in all kinds of layers, including the convolutional layers, normalization layers, and skip connections, allowing the inference to be executed using integer-only arithmetic. To demonstrate the improved latency-vs-accuracy trade-off, we apply the proposed methods on RetinaNet and FCOS. In particular, experimental results on MS-COCO dataset show that our AQD achieves comparable or even better performance compared with the full-precision counterpart under extremely low-bit schemes, which is of great practical value. Source code and models are available at: https://github.com/ziplab/QTool
Code (1)
Tasks
Image ClassificationObjectobject-detectionObject DetectionQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fully Quantized Network for Object Detection
Efficient neural network inference is important in a number of practical domains, such as deployment in mobile settings. An effective method for increasing inference efficiency is to use low bitwidth arithmetic, which c…
Efficient Neural NetworkObjectobject-detectionObject Detection+1AttentionNet: Aggregating Weak Directions for Accurate Object Detection
We present a novel detection method using a deep convolutional neural network (CNN), named AttentionNet. We cast an object detection problem as an iterative classification problem, which is the most suitable form of a CN…
General ClassificationHuman DetectionObjectobject-detection+2Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector
Although deep learning based object detection is of great significance for various applications it faces challenges when deployed on edge devices due to the computation and energy limitations. Post-training quantizat…
Objectobject-detectionObject DetectionQuantization+1LCDet: Low-Complexity Fully-Convolutional Neural Networks for Object Detection in Embedded Systems
Deep convolutional Neural Networks (CNN) are the state-of-the-art performers for object detection task. It is well known that object detection requires more computation and memory than image classification. Thus the cons…
Face Detectionimage-classificationImage ClassificationObject+3Reducing the Side-Effects of Oscillations in Training of Quantized YOLO Networks
Quantized networks use less computational and memory resources and are suitable for deployment on edge devices. While quantization-aware training QAT is the well-studied approach to quantize the networks at low precision…
object-detectionObject DetectionQuantizationSemantic Segmentation