paper-with-me

Papers

Stacked Quantizers for Compositional Vector Compression

2014-11-08 · Julieta Martinez, Holger H. Hoos, James J. Little

Recently, Babenko and Lempitsky introduced Additive Quantization (AQ), a generalization of Product Quantization (PQ) where a non-independent set of codebooks is used to compress vectors into small binary codes. Unfortunately, under this scheme encoding cannot be done independently in each codebook, and optimal encoding is an NP-hard problem. In this paper, we observe that PQ and AQ are both compositional quantizers that lie on the extremes of the codebook dependence-independence assumption, and explore an intermediate approach that exploits a hierarchical structure in the codebooks. This results in a method that achieves quantization error on par with or lower than AQ, while being several orders of magnitude faster. We perform a complexity analysis of PQ, AQ and our method, and evaluate our approach on standard benchmarks of SIFT and GIST descriptors, as well as on new datasets of features obtained from state-of-the-art convolutional neural networks.

📄 PDF Abstract BibTeX arXiv:1411.2173

Code (2)

una-dinosauria/Rayuela.jl 공식 구현
una-dinosauria/stacked-quantizers

Tasks

Quantization

Similar Papers 제목 키워드 기반

Rate distortion comparison of a few gradient quantizers

2021-08-23 · Tharindu Adikari

This article is in the context of gradient compression. Gradient compression is a popular technique for mitigating the communication bottleneck observed when training large machine learning models in a distributed manner…

Quantization

LVQAC: Lattice Vector Quantization Coupled with Spatially Adaptive Companding for Efficient Learned Image Compression

2023-03-25 · CVPR 2023 1 · Xi Zhang, Xiaolin Wu

Recently, numerous end-to-end optimized image compression neural networks have been developed and proved themselves as leaders in rate-distortion performance. The main strength of these learnt compression methods is in p…

Image CompressionQuantization

Individualized non-uniform quantization for vector search

2025-09-22 · Mariano Tepper, Ted Willke arxiv

Embedding vectors are widely used for representing unstructured data and searching through it for semantically similar items. However, the large size of these vectors, due to their high-dimensionality, creates problems f…

Switchcodec: Adaptive residual-expert sparse quantization for high-fidelity neural audio coding

2026-01-28 · Xiangbo Wang, Wenbin Jiang, Jin Wang, Yubo You 외 arxiv

Recent neural audio compression models often rely on residual vector quantization for high-fidelity coding, but using a fixed number of per-frame codebooks is suboptimal for the wide variability of audio content-especial…

SNAC: Multi-Scale Neural Audio Codec

2024-10-18 · Hubert Siuzdak, Florian Grötschla, Luca A. Lanzendörfer

Neural audio codecs have recently gained popularity because they can represent audio signals with high fidelity at very low bitrates, making it feasible to use language modeling approaches for audio generation and unders…

Audio CompressionAudio GenerationLanguage ModelingLanguage Modelling+1