Transformer-based Clipped Contrastive Quantization Learning for Unsupervised Image Retrieval
Unsupervised image retrieval aims to learn the important visual characteristics without any given level to retrieve the similar images for a given query image. The Convolutional Neural Network (CNN)-based approaches have been extensively exploited with self-supervised contrastive learning for image hashing. However, the existing approaches suffer due to lack of effective utilization of global features by CNNs and biased-ness created by false negative pairs in the contrastive learning. In this paper, we propose a TransClippedCLR model by encoding the global context of an image using Transformer having local context through patch based processing, by generating the hash codes through product quantization and by avoiding the potential false negative pairs through clipped contrastive learning. The proposed model is tested with superior performance for unsupervised image retrieval on benchmark datasets, including CIFAR10, NUS-Wide and Flickr25K, as compared to the recent state-of-the-art deep models. The results using the proposed clipped contrastive learning are greatly improved on all datasets as compared to same backbone network with vanilla contrastive learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage RetrievalQuantizationRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contrastive Quantization with Code Memory for Unsupervised Image Retrieval
The high efficiency in computation and storage makes hashing (including binary hashing and quantization) a common strategy in large-scale retrieval systems. To alleviate the reliance on expensive annotations, unsupervise…
Contrastive LearningDeep HashingDiversityImage Retrieval+1Towards Clip-Free Quantized Super-Resolution Networks: How to Tame Representative Images
Super-resolution (SR) networks have been investigated for a while, with their mobile and lightweight versions gaining noticeable popularity recently. Quantization, the procedure of decreasing the precision of network par…
QuantizationSuper-ResolutionSelf-Supervised Consistent Quantization for Fully Unsupervised Image Retrieval
Unsupervised image retrieval aims to learn an efficient retrieval system without expensive data annotations, but most existing methods rely heavily on handcrafted feature descriptors or pre-trained feature extractors. To…
Contrastive LearningImage RetrievalQuantizationRetrievalMix-QViT: Mixed-Precision Vision Transformer Quantization Driven by Layer Importance and Quantization Sensitivity
In this paper, we propose Mix-QViT, an explainability-driven MPQ framework that systematically allocates bit-widths to each layer based on two criteria: layer importance, assessed via Layer-wise Relevance Propagation (LR…
QuantizationSensitivityCPT-V: A Contrastive Approach to Post-Training Quantization of Vision Transformers
When considering post-training quantization, prior work has typically focused on developing a mixed precision scheme or learning the best way to partition a network for quantization. In our work, CPT-V, we look at a gene…
QuantizationSelf-Supervised Learning