paper-with-me

홈 › Papers

Make RepVGG Greater Again: A Quantization-aware Approach

2022-12-03 · Xiangxiang Chu, Liang Li, Bo Zhang

The tradeoff between performance and inference speed is critical for practical applications. Architecture reparameterization obtains better tradeoffs and it is becoming an increasingly popular ingredient in modern convolutional neural networks. Nonetheless, its quantization performance is usually too poor to deploy (more than 20% top-1 accuracy drop on ImageNet) when INT8 inference is desired. In this paper, we dive into the underlying mechanism of this failure, where the original design inevitably enlarges quantization error. We propose a simple, robust, and effective remedy to have a quantization-friendly structure that also enjoys reparameterization benefits. Our method greatly bridges the gap between INT8 and FP32 accuracy for RepVGG. Without bells and whistles, the top-1 accuracy drop on ImageNet is reduced within 2% by standard post-training quantization. Moreover, our method also achieves similar FP32 performance as RepVGG. Extensive experiments on detection and semantic segmentation tasks verify its generalization.

📄 PDF Abstract BibTeX arXiv:2212.01593

Code (2)

2023-MindSpore-4/Code14/tree/main/RepVGG mindspore
MindSpore-paper-code-3/code5/tree/main/repvgg mindspore

Tasks

QuantizationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Batch Normalization 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
RepVGG RepVGG is a VGG-style convolutional architecture. It has the following advantages: - The model has a VGG-like plain (a.k.a.…

Similar Papers 제목 키워드 기반

Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks

2024-02-11 · Muqun Niu, Yuan Ren, Boyu Li, Chenchen Ding

Lightweight design of Convolutional Neural Networks (CNNs) requires co-design efforts in the model architectures and compression techniques. As a novel design paradigm that separates training and inference, a structural …

Quantization

RepVGG: Making VGG-style ConvNets Great Again

2021-01-11 · CVPR 2021 1 · Xiaohan Ding, Xiangyu Zhang, Ningning Ma, Jungong Han 외

We present a simple but powerful architecture of convolutional neural network, which has a VGG-like inference-time body composed of nothing but a stack of 3x3 convolution and ReLU, while the training-time model has a mul…

GPUImage ClassificationSemantic Segmentation

RepVGG-GELAN: Enhanced GELAN with VGG-STYLE ConvNets for Brain Tumour Detection

2024-05-06 · Thennarasi Balakrishnan, Sandeep Singh Sengar

Object detection algorithms particularly those based on YOLO have demonstrated remarkable efficiency in balancing speed and accuracy. However, their application in brain tumour detection remains underexplored. This study…

Computational Efficiencyobject-detectionObject Detection

Detection of Small Targets in Sea Clutter Based on RepVGG and Continuous Wavelet Transform

2023-11-14 · Jingchen Ni, Haoru Li, Lilin Xu, Jing Liang

Constructing a high-performance target detector under the background of sea clutter is always necessary and important. In this work, we propose a RepVGGA0-CWT detector, where RepVGG is a residual network that gains a hig…

EfficientRep:An Efficient Repvgg-style ConvNets with Hardware-aware Neural Network Design

2023-02-01 · Kaiheng Weng, Xiangxiang Chu, Xiaoming Xu, Junshi Huang 외

We present a hardware-efficient architecture of convolutional neural network, which has a repvgg-like architecture. Flops or parameters are traditional metrics to evaluate the efficiency of networks which are not sensiti…

GPUobject-detectionObject Detection