paper-with-me

Papers

Quantization-aware Matrix Factorization for Low Bit Rate Image Compression

2024-08-22 · Pooya Ashtari, Pourya Behmandpoor, Fateme Nateghi Haredasht, Jonathan H. Chen, Panagiotis Patrinos, Sabine Van Huffel

Lossy image compression is essential for efficient transmission and storage. Traditional compression methods mainly rely on discrete cosine transform (DCT) or singular value decomposition (SVD), both of which represent image data in continuous domains and, therefore, necessitate carefully designed quantizers. Notably, these methods consider quantization as a separate step, where quantization errors cannot be incorporated into the compression process. The sensitivity of these methods, especially SVD-based ones, to quantization errors significantly degrades reconstruction quality. To address this issue, we introduce a quantization-aware matrix factorization (QMF) to develop a novel lossy image compression method. QMF provides a low-rank representation of the image data as a product of two smaller factor matrices, with elements constrained to bounded integer values, thereby effectively integrating quantization with low-rank approximation. We propose an efficient, provably convergent iterative algorithm for QMF using a block coordinate descent (BCD) scheme, with subproblems having closed-form solutions. Our experiments on the Kodak and CLIC 2024 datasets demonstrate that our QMF compression method consistently outperforms JPEG at low bit rates below 0.25 bits per pixel (bpp) and remains comparable at higher bit rates. We also assessed our method's capability to preserve visual semantics by evaluating an ImageNet pre-trained classifier on compressed images. Remarkably, our method improved top-1 accuracy by over 5 percentage points compared to JPEG at bit rates under 0.25 bpp. The project is available at https://github.com/pashtari/lrf .

📄 PDF Abstract BibTeX arXiv:2408.12691

Code (1)

pashtari/lrf 공식 구현 pytorch

Tasks

Image CompressionQuantization

Methods 이 논문이 사용한 방법론

Discrete Cosine Transform Discrete Cosine Transform (DCT) is an orthogonal transformation method that decomposes an image to its spatial frequency spectrum. It expresses a finite sequence of data…

Similar Papers 제목 키워드 기반

Low-bit quantization and quantization-aware training for small-footprint keyword spotting

2018-10-19 · Yuriy Mishchenko, Yusuf Goren, Ming Sun, Chris Beauchene 외

We investigate low-bit quantization to reduce computational cost of deep neural network (DNN) based keyword spotting (KWS). We propose approaches to further reduce quantization bits via integrating quantization into keyw…

Keyword SpottingQuantizationSmall-Footprint Keyword Spotting

Compression of Acoustic Event Detection Models with Low-rank Matrix Factorization and Quantization Training

2019-05-02 · NIPS Workshop CDNNRIA 2018 · Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic 외

In this paper, we present a compression approach based on the combination of low-rank matrix factorization and quantization training, to reduce complexity for neural network based acoustic event detection (AED) models. O…

Event DetectionQuantization

LittleBit: Ultra Low-Bit Quantization via Latent Factorization

2025-05-30 · Banseok Lee, Dongkyu Kim, Youngcheon You, Youngmin Kim

Deploying large language models (LLMs) often faces challenges from substantial memory and computational costs. Quantization offers a solution, yet performance degradation in the sub-1-bit regime remains particularly diff…

Quantization

Hybrid Deep-Semantic Matrix Factorization for Tag-Aware Personalized Recommendation

2017-08-12 · Xu Zhenghua, Chen Cheng, Lukasiewicz Thomas, Miao Yishu

Matrix factorization has now become a dominant solution for personalized recommendation on the Social Web. To alleviate the cold start problem, previous approaches have incorporated various additional sources of informat…

TAG

Supervised Matrix Factorization for Cross-Modality Hashing

2016-04-16 · Liu Hong, Ji Rongrong, Wu Yongjian, Hua Gang

Matrix factorization has been recently utilized for the task of multi-modal hashing for cross-modality visual search, where basis functions are learned to map data from different modalities to the same Hamming embedding.…

QuantizationRetrievalSentence