Structured Pruning and Quantization for Learned Image Compression
The high computational costs associated with large deep learning models significantly hinder their practical deployment. Model pruning has been widely explored in deep learning literature to reduce their computational burden, but its application has been largely limited to computer vision tasks such as image classification and object detection. In this work, we propose a structured pruning method targeted for Learned Image Compression (LIC) models that aims to reduce the computational costs associated with image compression while maintaining the rate-distortion performance. We employ a Neural Architecture Search (NAS) method based on the rate-distortion loss for computing the pruning ratio for each layer of the network. We compare our pruned model with the uncompressed LIC Model with same network architecture and show that it can achieve model size reduction without any BD-Rate performance drop. We further show that our pruning method can be integrated with model quantization to achieve further model compression while maintaining similar BD-Rate performance. We have made the source code available at gitlab.com/viper-purdue/lic-pruning.
Code (1)
Tasks
image-classificationImage ClassificationImage CompressionModel CompressionNeural Architecture Searchobject-detectionObject DetectionQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networks
This work evaluates the compression techniques on ConvNeXt models in image classification tasks using the CIFAR-10 dataset. Structured pruning, unstructured pruning, and dynamic quantization methods are evaluated to redu…
Edge-computingimage-classificationImage ClassificationModel Compression+1Differentiable Joint Pruning and Quantization for Hardware Efficiency
We present a differentiable joint pruning and quantization (DJPQ) scheme. We frame neural network compression as a joint gradient-based optimization problem, trading off between model pruning and quantization automatical…
Neural Network CompressionQuantizationStructured Compression by Weight Encryption for Unstructured Pruning and Quantization
Model compression techniques, such as pruning and quantization, are becoming increasingly important to reduce the memory footprints and the amount of computations. Despite model size reduction, achieving performance enha…
Model CompressionQuantizationCLIP-Q: Deep Network Compression Learning by In-Parallel Pruning-Quantization
Deep neural networks enable state-of-the-art accuracy on visual recognition tasks such as image classification and object detection. However, modern deep networks contain millions of learned weights; a more efficient uti…
image-classificationImage ClassificationNetwork Pruningobject-detection+2Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning
Structured pruning and quantization are promising approaches for reducing the inference time and memory footprint of neural networks. However, most existing methods require the original training dataset to fine-tune the …
image-classificationImage ClassificationQuantization