Neural Network Compression using Transform Coding and Clustering

2018-05-18 · NIPS Workshop CDNNRIA 2018 · Thorsten Laude, Yannick Richter, Jörn Ostermann

With the deployment of neural networks on mobile devices and the necessity of transmitting neural networks over limited or expensive channels, the file size of the trained model was identified as bottleneck. In this paper, we propose a codec for the compression of neural networks which is based on transform coding for convolutional and dense layers and on clustering for biases and normalizations. By using this codec, we achieve average compression factors between 7.9-9.3 while the accuracy of the compressed networks for image classification decreases only by 1%-2%, respectively.

📄 PDF Abstract BibTeX arXiv:1805.07258

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringGeneral Classification image-classification Image Classification Neural Network Compression

Another Way to the Top: Exploit Contextual Clustering in Learned Image Coding

2024-01-21 · Yichi Zhang, Zhihao Duan, Ming Lu, Dandan Ding 외

While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies o…

Clustering Image Compression MS-SSIM Quantization+1

A Self-Supervised Learning Framework for Video Encoding Complexity Clustering

2026-06-28 · Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis 외 arxiv

Adaptive video streaming is a widely used technique for delivering video content over the internet. One of the key challenges is determining the optimal encoding settings for each video, which can vary significantly base…

Self-Supervised Learning Contrastive Learning

Comparing of Term Clustering Frameworks for Modular Ontology Learning

2019-01-25 · Ziwei Xu, Mounira Harzallah, Fabrice Guillet

This paper aims to use term clustering to build a modular ontology according to core ontology from domain-specific text. The acquisition of semantic knowledge focuses on noun phrase appearing with the same syntactic role…

Clustering Dimensionality Reduction Feature Compression feature selection+1

Efficient Predictive Coding of Intra Prediction Modes

2023-10-09 · Kevin Reuzé, Wassim Hamidouche, Pierrick Philippe, Olivier Déforges

The high efficiency video coding (HEVC) standard and the joint exploration model (JEM) codec incorporate 35 and 67 intra prediction modes (IPMs) respectively, which are essential for efficient compression of Intra coded …

Clustering Decoder Prediction

Text Compression-aided Transformer Encoding

2021-02-11 · Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang 외

Text encoding is one of the most important steps in Natural Language Processing (NLP). It has been done well by the self-attention mechanism in the current state-of-the-art Transformer encoder, which has brought about si…

Text Compression