paper-with-me

Papers

A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance

2023-08-25 · ICCV 2023 1 · Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig

We present accumulator-aware quantization (A2Q), a novel weight quantization method designed to train quantized neural networks (QNNs) to avoid overflow when using low-precision accumulators during inference. A2Q introduces a unique formulation inspired by weight normalization that constrains the L1-norm of model weights according to accumulator bit width bounds that we derive. Thus, in training QNNs for low-precision accumulation, A2Q also inherently promotes unstructured weight sparsity to guarantee overflow avoidance. We apply our method to deep learning-based computer vision tasks to show that A2Q can train QNNs for low-precision accumulators while maintaining model accuracy competitive with a floating-point baseline. In our evaluations, we consider the impact of A2Q on both general-purpose platforms and programmable hardware. However, we primarily target model deployment on FPGAs because they can be programmed to fully exploit custom accumulator bit widths. Our experimentation shows accumulator bit width significantly impacts the resource efficiency of FPGA-based accelerators. On average across our benchmarks, A2Q offers up to a 2.3x reduction in resource utilization over 32-bit accumulator counterparts with 99.2% of the floating-point model accuracy.

📄 PDF Abstract BibTeX arXiv:2308.13504

Code (1)

Xilinx/brevitas/tree/f0978b2d6df559dff9097d4e3c8ffbbcfd934b96/src/brevitas_examples/super_resolution pytorch

Tasks

Quantization

Methods 이 논문이 사용한 방법론

Weight Normalization Weight Normalization is a normalization method for training neural networks. It is inspired by batch normalization,…

Similar Papers 제목 키워드 기반

A2Q+: Improving Accumulator-Aware Weight Quantization

2024-01-19 · Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig, Yaman Umuroglu

Quantization techniques commonly reduce the inference costs of neural networks by restricting the precision of weights and activations. Recent studies show that also reducing the precision of the accumulator can further …

Quantization

Quantized Neural Networks for Low-Precision Accumulation with Guaranteed Overflow Avoidance

2023-01-31 · Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig

We introduce a quantization-aware training algorithm that guarantees avoiding numerical overflow when reducing the precision of accumulators during inference. We leverage weight normalization as a means of constraining p…

Quantization

Accumulator-Aware Post-Training Quantization

2024-09-25 · Ian Colbert, Fabian Grob, Giuseppe Franco, Jinjie Zhang 외

Several recent studies have investigated low-precision accumulation, reporting improvements in throughput, power, and area across various platforms. However, the accompanying proposals have only considered the quantizati…

image-classificationImage ClassificationQuantizationText Generation

Accelerating Neural Network Inference by Overflow Aware Quantization

2020-05-27 · Hongwei Xie, Shuo Zhang, Huanghao Ding, Yafei Song 외

The inherent heavy computation of deep neural networks prevents their widespread applications. A widely used method for accelerating model inference is quantization, by replacing the input operands of a network using fix…

image-classificationImage Classificationobject-detectionObject Detection+2

Quantized Decoder in Learned Image Compression for Deterministic Reconstruction

2023-12-18 · Esin Koyuncu, Timofey Solovyev, Johannes Sauer, Elena Alshina 외

Learned image compression has a problem of non-bit-exact reconstruction due to different calculations of floating point arithmetic on different devices. This paper shows a method to achieve a deterministic reconstructed …

DecoderImage CompressionQuantization