paper-with-me

홈 › Papers

Compressing Unknown Images With Product Quantizer for Efficient Zero-Shot Classification

2019-06-01 · CVPR 2019 6 · Jin Li, Xuguang Lan, Yang Liu, Le Wang, Nanning Zheng

For Zero-Shot Learning (ZSL), the Nearest Neighbor (NN) search is generally conducted for classification, which may cause unacceptable computational complexity for large-scale datasets. To compress zero-shot classes by the trained quantizer for efficient search, it tends to induce large quantization error because distributions between seen and unseen classes are different. However, as semantic attributes of classes are available in ZSL, both seen and unseen classes have the same distribution for one specific property, e.g., animals have or not have spots. Based on this intuition, a Product Quantization Zero-Shot Learning (PQZSL) method is proposed to learn embeddings as well as quantizers to compress visual features into compact codes for Approximate NN (ANN) search. Particularly, visual features are projected into an orthogonal semantic space, and then the Product Quantization (PQ) is utilized to quantize individual properties. Experimental results on five benchmark datasets demonstrate that unseen classes are represented by the Cartesian product of quantized properties with little quantization error. As classes in orthogonal common space are more discriminative, the classification based on PQZSL achieves state-of-the-art performance in Generalized Zero-Shot Learning (GZSL) task, meanwhile, the speed of ANN search is 10-100 times higher than traditional NN search.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationGeneralized Zero-Shot LearningQuantizationzero-shot-classificationZero-Shot Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate

2025-04-28 · Amir Zandieh, Majid Daliri, Majid Hadian, Vahab Mirrokni

Vector quantization, a problem rooted in Shannon's source coding theory, aims to quantize high-dimensional Euclidean vectors while minimizing distortion in their geometric structure. We propose TurboQuant to address both…

Quantization

Product Quantizer Aware Inverted Index for Scalable Nearest Neighbor Search

2021-01-01 · ICCV 2021 10 · Haechan Noh, TaeHo Kim, Jae-Pil Heo

The inverted index is one of the most commonly used structures for non-exhaustive nearest neighbor search on large-scale datasets. It allows a significant factor of acceleration by a reduced number of distance comput…

Quantization

Memory Efficient Optimizers with 4-bit States

2023-09-21 · NeurIPS 2023 11

Optimizer states are a major source of memory consumption for training neural networks, limiting the maximum trainable model within given memory budget. Compressing the optimizer states from 32-bit floating points to low…

RATQ: A Universal Fixed-Length Quantizer for Stochastic Optimization

2019-08-22 · Prathamesh Mayekar, Himanshu Tyagi

We present Rotated Adaptive Tetra-iterated Quantizer (RATQ), a fixed-length quantizer for gradients in first order stochastic optimization. RATQ is easy to implement and involves only a Hadamard transform computation and…

QuantizationStochastic Optimization

Derived Codebooks for High-Accuracy Nearest Neighbor Search

2019-05-16 · Fabien André, Anne-Marie Kermarrec, Nicolas Le Scouarnec

High-dimensional Nearest Neighbor (NN) search is central in multimedia search systems. Product Quantization (PQ) is a widespread NN search technique which has a high performance and good scalability. PQ compresses high-d…

QuantizationVocal Bursts Intensity Prediction