paper-with-me

홈 › Papers

MINT: Multiplier-less INTeger Quantization for Energy Efficient Spiking Neural Networks

2023-05-16 · Ruokai Yin, Yuhang Li, Abhishek Moitra, Priyadarshini Panda

We propose Multiplier-less INTeger (MINT) quantization, a uniform quantization scheme that efficiently compresses weights and membrane potentials in spiking neural networks (SNNs). Unlike previous SNN quantization methods, MINT quantizes memory-intensive membrane potentials to an extremely low precision (2-bit), significantly reducing the memory footprint. MINT also shares the quantization scaling factor between weights and membrane potentials, eliminating the need for multipliers required in conventional uniform quantization. Experimental results show that our method matches the accuracy of full-precision models and other state-of-the-art SNN quantization techniques while surpassing them in memory footprint reduction and hardware cost efficiency at deployment. For example, 2-bit MINT VGG-16 achieves 90.6% accuracy on CIFAR-10, with roughly 93.8% reduction in memory footprint from the full-precision model and 90% reduction in computation energy compared to vanilla uniform quantization at deployment. The code is available at https://github.com/Intelligent-Computing-Lab-Yale/MINT-Quantization.

📄 PDF Abstract BibTeX arXiv:2305.09850

Code (1)

intelligent-computing-lab-yale/mint-quantization 공식 구현

Tasks

Quantization

Similar Papers 제목 키워드 기반

Linear Symmetric Quantization of Neural Networks for Low-precision Integer Hardware

2020-05-01 · ICLR 2020 1 · Xiandong Zhao, Ying Wang, Xuyi Cai, Cheng Liu 외

With the proliferation of specialized neural network processors that operate on low-precision integers, the performance of Deep Neural Network inference becomes increasingly dependent on the result of quantization. Despi…

object-detectionObject DetectionQuantization

FAMES: Fast Approximate Multiplier Substitution for Mixed-Precision Quantized DNNs--Down to 2 Bits!

2024-11-27 · Yi Ren, Ruge Xu, Xinfei Guo, Weikang Qian

A widely-used technique in designing energy-efficient deep neural network (DNN) accelerators is quantization. Recent progress in this direction has reduced the bitwidths used in DNN down to 2. Meanwhile, many prior works…

Quantization

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

2020-12-21 · Rui Chen, Liang Li, Kaiping Xue, Chi Zhang 외

Federated learning (FL) is a popular collaborative distributed machine learning paradigm across mobile devices. However, practical FL over resource constrained mobile devices confronts multiple challenges, e.g., the loca…

Edge-computingFederated LearningQuantization

Integer-only Quantized Transformers for Embedded FPGA-based Time-series Forecasting in AIoT

2024-07-06 · Tianheng Ling, Chao Qian, Gregor Schiele

This paper presents the design of a hardware accelerator for Transformers, optimized for on-device time-series forecasting in AIoT systems. It integrates integer-only quantization and Quantization-Aware Training with opt…

QuantizationTime SeriesTime Series Forecasting

FPQVAR: Floating Point Quantization for Visual Autoregressive Model with FPGA Hardware Co-design

2025-05-22 · Renjie Wei, Songqiang Xu, Qingyu Guo, Meng Li

Visual autoregressive (VAR) modeling has marked a paradigm shift in image generation from next-token prediction to next-scale prediction. VAR predicts a set of tokens at each step from coarse to fine scale, leading to be…

GPUImage GenerationQuantization