paper-with-me

Papers

Picking Up Quantization Steps for Compressed Image Classification

2023-04-21 · Li Ma, Peixi Peng, Guangyao Chen, Yifan Zhao, Siwei Dong, Yonghong Tian

The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file. In this paper, we argue that neglected disposable coding parameters stored in compressed files could be picked up to reduce the sensitivity of deep neural networks to compressed images. Specifically, we resort to using one of the representative parameters, quantization steps, to facilitate image classification. Firstly, based on quantization steps, we propose a novel quantization aware confidence (QAC), which is utilized as sample weights to reduce the influence of quantization on network training. Secondly, we utilize quantization steps to alleviate the variance of feature distributions, where a quantization aware batch normalization (QABN) is proposed to replace batch normalization of classification networks. Extensive experiments show that the proposed method significantly improves the performance of classification networks on CIFAR-10, CIFAR-100, and ImageNet. The code is released on https://github.com/LiMaPKU/QSAM.git

📄 PDF Abstract BibTeX arXiv:2304.10714

Code (1)

limapku/qsam 공식 구현 pytorch

Tasks

Classificationimage-classificationImage ClassificationQuantizationSensitivity

Methods 이 논문이 사용한 방법론

fail 설명 없음
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

One-Index Vector Quantization Based Adversarial Attack on Image Classification

2024-09-02 · Haiju Fan, Xiaona Qin, Shuang Chen, Hubert P. H. Shum 외

To improve storage and transmission, images are generally compressed. Vector quantization (VQ) is a popular compression method as it has a high compression ratio that suppresses other compression techniques. Despite this…

Adversarial Attackimage-classificationImage ClassificationQuantization

Wavelet Feature Maps Compression for Image-to-Image CNNs

2022-05-24 · Shahaf E. Finder, Yair Zohav, Maor Ashkenazi, Eran Treister

Convolutional Neural Networks (CNNs) are known for requiring extensive computational resources, and quantization is among the best and most common methods for compressing them. While aggressive quantization (i.e., less t…

Depth EstimationNeural Network CompressionQuantizationSemantic Segmentation

Additive Quantization for Extreme Vector Compression

2014-06-01 · CVPR 2014 6 · Artem Babenko, Victor Lempitsky

We introduce a new compression scheme for high-dimensional vectors that approximates the vectors using sums of M codewords coming from M different codebooks. We show that the proposed scheme permits efficient distance an…

General Classificationimage-classificationImage ClassificationQuantization

Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs

2026-08-21 · Bakbergen Ryskulov, Iker García-Ferrero, David Montero, David Jansen 외 arxiv

Serving large language models cheaply increasingly means shipping models that are both structurally compressed to a fraction of their parameters and quantized to 4 bits. Together these steps degrade reasoning, mathematic…

High Dimensional Statistical Estimation under Uniformly Dithered One-bit Quantization

2022-02-26 · Junren Chen, Cheng-Long Wang, Michael K. Ng, Di Wang

In this paper, we propose a uniformly dithered 1-bit quantization scheme for high-dimensional statistical estimation. The scheme contains truncation, dithering, and quantization as typical steps. As canonical examples, t…

compressed sensingLow-Rank Matrix CompletionMatrix CompletionQuantization+1