Fast Training of Triplet-based Deep Binary Embedding Networks
In this paper, we aim to learn a mapping (or embedding) from images to a compact binary space in which Hamming distances correspond to a ranking measure for the image retrieval task. We make use of a triplet loss because this has been shown to be most effective for ranking problems. However, training in previous works can be prohibitively expensive due to the fact that optimization is directly performed on the triplet space, where the number of possible triplets for training is cubic in the number of training examples. To address this issue, we propose to formulate high-order binary codes learning as a multi-label classification problem by explicitly separating learning into two interleaved stages. To solve the first stage, we design a large-scale high-order binary codes inference algorithm to reduce the high-order objective to a standard binary quadratic problem such that graph cuts can be used to efficiently infer the binary code which serve as the label of each training datum. In the second stage we propose to map the original image to compact binary codes via carefully designed deep convolutional neural networks (CNNs) and the hashing function fitting can be solved by training binary CNN classifiers. An incremental/interleaved optimization strategy is proffered to ensure that these two steps are interactive with each other during training for better accuracy. We conduct experiments on several benchmark datasets, which demonstrate both improved training time (by as much as two orders of magnitude) as well as producing state-of-the-art hashing for various retrieval tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRetrievalTripletSimilar Papers 제목 키워드 기반
Improving Deep Binary Embedding Networks by Order-aware Reweighting of Triplets
In this paper, we focus on triplet-based deep binary embedding networks for image retrieval task. The triplet loss has been shown to be most effective for the ranking problem. However, most of the previous works treat th…
Image RetrievalRetrievalTripletTiny Descriptors for Image Retrieval with Unsupervised Triplet Hashing
A typical image retrieval pipeline starts with the comparison of global descriptors from a large database to find a short list of candidate matches. A good image descriptor is key to the retrieval pipeline and should rec…
image-classificationImage ClassificationImage RetrievalRetrieval+1Image-Text Retrieval with Binary and Continuous Label Supervision
Most image-text retrieval work adopts binary labels indicating whether a pair of image and text matches or not. Such a binary indicator covers only a limited subset of image-text semantic relations, which is insufficient…
Image CaptioningImage-text RetrievalRetrievalText Retrieval+2Smart Mining for Deep Metric Learning
To solve deep metric learning problems and producing feature embeddings, current methodologies will commonly use a triplet model to minimise the relative distance between samples from the same class and maximise the rela…
Metric LearningTripletDeep Triplet Quantization
Deep hashing establishes efficient and effective image retrieval by end-to-end learning of deep representations and hash codes from similarity data. We present a compact coding solution, focusing on deep learning to quan…
Deep HashingImage RetrievalQuantizationRetrieval+1