paper-with-me

Papers

Transformer-based Clipped Contrastive Quantization Learning for Unsupervised Image Retrieval

2024-01-27 · Ayush Dubey, Shiv Ram Dubey, Satish Kumar Singh, Wei-Ta Chu

Unsupervised image retrieval aims to learn the important visual characteristics without any given level to retrieve the similar images for a given query image. The Convolutional Neural Network (CNN)-based approaches have been extensively exploited with self-supervised contrastive learning for image hashing. However, the existing approaches suffer due to lack of effective utilization of global features by CNNs and biased-ness created by false negative pairs in the contrastive learning. In this paper, we propose a TransClippedCLR model by encoding the global context of an image using Transformer having local context through patch based processing, by generating the hash codes through product quantization and by avoiding the potential false negative pairs through clipped contrastive learning. The proposed model is tested with superior performance for unsupervised image retrieval on benchmark datasets, including CIFAR10, NUS-Wide and Flickr25K, as compared to the recent state-of-the-art deep models. The results using the proposed clipped contrastive learning are greatly improved on all datasets as compared to same backbone network with vanilla contrastive learning.

📄 PDF Abstract BibTeX arXiv:2401.15362

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningImage RetrievalQuantizationRetrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Contrastive Quantization with Code Memory for Unsupervised Image Retrieval

2021-09-11 · Jinpeng Wang, Ziyun Zeng, Bin Chen, Tao Dai 외

The high efficiency in computation and storage makes hashing (including binary hashing and quantization) a common strategy in large-scale retrieval systems. To alleviate the reliance on expensive annotations, unsupervise…

Contrastive LearningDeep HashingDiversityImage Retrieval+1

Towards Clip-Free Quantized Super-Resolution Networks: How to Tame Representative Images

2023-08-22 · Alperen Kalay, Bahri Batuhan Bilecen, Mustafa Ayazoglu

Super-resolution (SR) networks have been investigated for a while, with their mobile and lightweight versions gaining noticeable popularity recently. Quantization, the procedure of decreasing the precision of network par…

QuantizationSuper-Resolution

Self-Supervised Consistent Quantization for Fully Unsupervised Image Retrieval

2022-06-20 · Guile Wu, Chao Zhang, Stephan Liwicki

Unsupervised image retrieval aims to learn an efficient retrieval system without expensive data annotations, but most existing methods rely heavily on handcrafted feature descriptors or pre-trained feature extractors. To…

Contrastive LearningImage RetrievalQuantizationRetrieval

Mix-QViT: Mixed-Precision Vision Transformer Quantization Driven by Layer Importance and Quantization Sensitivity

2025-01-10 · Navin Ranjan, Andreas Savakis

In this paper, we propose Mix-QViT, an explainability-driven MPQ framework that systematically allocates bit-widths to each layer based on two criteria: layer importance, assessed via Layer-wise Relevance Propagation (LR…

QuantizationSensitivity

CPT-V: A Contrastive Approach to Post-Training Quantization of Vision Transformers

2022-11-17 · Natalia Frumkin, Dibakar Gope, Diana Marculescu

When considering post-training quantization, prior work has typically focused on developing a mixed precision scheme or learning the best way to partition a network for quantization. In our work, CPT-V, we look at a gene…

QuantizationSelf-Supervised Learning