Instance-level Sketch-based Retrieval by Deep Triplet Classification Siamese Network
Sketch has been employed as an effective communicative tool to express the abstract and intuitive meanings of object. Recognizing the free-hand sketch drawing is extremely useful in many real-world applications. While content-based sketch recognition has been studied for several decades, the instance-level Sketch-Based Image Retrieval (SBIR) tasks have attracted significant research attention recently. The existing datasets such as QMUL-Chair and QMUL-Shoe, focus on the retrieval tasks of chairs and shoes. However, there are several key limitations in previous instance-level SBIR works. The state-of-the-art works have to heavily rely on the pre-training process, quality of edge maps, multi-cropping testing strategy, and augmenting sketch images. To efficiently solve the instance-level SBIR, we propose a new Deep Triplet Classification Siamese Network (DeepTCNet) which employs DenseNet-169 as the basic feature extractor and is optimized by the triplet loss and classification loss. Critically, our proposed DeepTCNet can break the limitations existed in previous works. The extensive experiments on five benchmark sketch datasets validate the effectiveness of the proposed model. Additionally, to study the tasks of sketch-based hairstyle retrieval, this paper contributes a new instance-level photo-sketch dataset - Hairstyle Photo-Sketch dataset, which is composed of 3600 sketches and photos, and 2400 sketch-photo pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationImage RetrievalRetrievalSketch-Based Image RetrievalSketch RecognitionTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sketch Me That Shoe
We investigate the problem of fine-grained sketch-based image retrieval (SBIR), where free-hand human sketches are used as queries to perform instance-level retrieval of images. This is an extremely challenging task beca…
Data AugmentationImage RetrievalRetrievalSketch-Based Image Retrieval+1Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR
This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by putting forward a strong baseline that overshoots prior state-of-the-arts by ~11%. This is not via complicated design though, but …
Image RetrievalKnowledge DistillationSketch-Based Image RetrievalTripletLogoNet: a fine-grained network for instance-level logo sketch retrieval
Sketch-based image retrieval, which aims to use sketches as queries to retrieve images containing the same query instance, receives increasing attention in recent years. Although dramatic progress has been made in sketch…
2kBenchmarkingImage RetrievalRetrieval+1Generalisation and Sharing in Triplet Convnets for Sketch based Visual Search
We propose and evaluate several triplet CNN architectures for measuring the similarity between sketches and photographs, within the context of the sketch based image retrieval (SBIR) task. In contrast to recent fine-grai…
Data AugmentationDimensionality ReductionGeneral ClassificationImage Retrieval+3Sketch-QNet: A Quadruplet ConvNet for Color Sketch-based Image Retrieval
Architectures based on siamese networks with triplet loss have shown outstanding performance on the image-based similarity search problem. This approach attempts to discriminate between positive (relevant) and negative (…
Image RetrievalRetrievalSketch-Based Image RetrievalTriplet