Fully Quantized Network for Object Detection
Efficient neural network inference is important in a number of practical domains, such as deployment in mobile settings. An effective method for increasing inference efficiency is to use low bitwidth arithmetic, which can subsequently be accelerated using dedicated hardware. However, designing effective quantization schemes while maintaining network accuracy is challenging. In particular, current techniques face difficulty in performing fully end-to-end quantization, making use of aggressively low bitwidth regimes such as 4-bit, and applying quantized networks to complex tasks such as object detection. In this paper, we demonstrate that many of these difficulties arise because of instability during the fine-tuning stage of the quantization process, and propose several novel techniques to overcome these instabilities. We apply our techniques to produce fully quantized 4-bit detectors based on RetinaNet and Faster R-CNN, and show that these achieve state-of-the-art performance for quantized detectors. The mAP loss due to quantization using our methods is more than 3.8x less than the loss from existing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Efficient Neural NetworkObjectobject-detectionObject DetectionQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AQD: Towards Accurate Fully-Quantized Object Detection
Network quantization allows inference to be conducted using low-precision arithmetic for improved inference efficiency of deep neural networks on edge devices. However, designing aggressively low-bit (e.g., 2-bit) quanti…
Image ClassificationObjectobject-detectionObject Detection+1Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector
Although deep learning based object detection is of great significance for various applications it faces challenges when deployed on edge devices due to the computation and energy limitations. Post-training quantizat…
Objectobject-detectionObject DetectionQuantization+1LCDet: Low-Complexity Fully-Convolutional Neural Networks for Object Detection in Embedded Systems
Deep convolutional Neural Networks (CNN) are the state-of-the-art performers for object detection task. It is well known that object detection requires more computation and memory than image classification. Thus the cons…
Face Detectionimage-classificationImage ClassificationObject+3TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers
This paper introduces a highly flexible, quantized, memory-efficient, and ultra-lightweight object detection network, called TinyissimoYOLO. It aims to enable object detection on microcontrollers in the power domain of m…
Objectobject-detectionObject DetectionQuantization+1A Selective Quantization Tuner for ONNX Models
Quantization reduces the precision of deep neural networks to lower model size and computational demands, but often at the expense of accuracy. Fully quantized models can suffer significant accuracy degradation, and reso…