paper-with-me

홈 › Papers

Fully Quantized Network for Object Detection

2019-06-01 · CVPR 2019 6 · Rundong Li, Yan Wang, Feng Liang, Hongwei Qin, Junjie Yan, Rui Fan

Efficient neural network inference is important in a number of practical domains, such as deployment in mobile settings. An effective method for increasing inference efficiency is to use low bitwidth arithmetic, which can subsequently be accelerated using dedicated hardware. However, designing effective quantization schemes while maintaining network accuracy is challenging. In particular, current techniques face difficulty in performing fully end-to-end quantization, making use of aggressively low bitwidth regimes such as 4-bit, and applying quantized networks to complex tasks such as object detection. In this paper, we demonstrate that many of these difficulties arise because of instability during the fine-tuning stage of the quantization process, and propose several novel techniques to overcome these instabilities. We apply our techniques to produce fully quantized 4-bit detectors based on RetinaNet and Faster R-CNN, and show that these achieve state-of-the-art performance for quantized detectors. The mAP loss due to quantization using our methods is more than 3.8x less than the loss from existing methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Neural NetworkObjectobject-detectionObject DetectionQuantization

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FPN 설명 없음
Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…

Similar Papers 제목 키워드 기반

AQD: Towards Accurate Fully-Quantized Object Detection

2020-07-14 · CVPR 2021 1 · Peng Chen, Jing Liu, Bohan Zhuang, Mingkui Tan 외

Network quantization allows inference to be conducted using low-precision arithmetic for improved inference efficiency of deep neural networks on edge devices. However, designing aggressively low-bit (e.g., 2-bit) quanti…

Image ClassificationObjectobject-detectionObject Detection+1

Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector

2024-01-01 · CVPR 2024 1 · Yifu Ding, Weilun Feng, Chuyan Chen, Jinyang Guo 외

Although deep learning based object detection is of great significance for various applications it faces challenges when deployed on edge devices due to the computation and energy limitations. Post-training quantizat…

Objectobject-detectionObject DetectionQuantization+1

LCDet: Low-Complexity Fully-Convolutional Neural Networks for Object Detection in Embedded Systems

2017-05-16 · Subarna Tripathi, Gokce Dane, Byeongkeun Kang, Vasudev Bhaskaran 외

Deep convolutional Neural Networks (CNN) are the state-of-the-art performers for object detection task. It is well known that object detection requires more computation and memory than image classification. Thus the cons…

Face Detectionimage-classificationImage ClassificationObject+3

TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers

2023-05-22 · Julian Moosmann, Marco Giordano, Christian Vogt, Michele Magno

This paper introduces a highly flexible, quantized, memory-efficient, and ultra-lightweight object detection network, called TinyissimoYOLO. It aims to enable object detection on microcontrollers in the power domain of m…

Objectobject-detectionObject DetectionQuantization+1

A Selective Quantization Tuner for ONNX Models

2025-07-16 · Nikolaos Louloudakis, Ajitha Rajan arxiv

Quantization reduces the precision of deep neural networks to lower model size and computational demands, but often at the expense of accuracy. Fully quantized models can suffer significant accuracy degradation, and reso…