Compact and Effective Representations for Sketch-based Image Retrieval
Sketch-based image retrieval (SBIR) has undergone an increasing interest in the community of computer vision bringing high impact in real applications. For instance, SBIR brings an increased benefit to eCommerce search engines because it allows users to formulate a query just by drawing what they need to buy. However, current methods showing high precision in retrieval work in a high dimensional space, which negatively affects aspects like memory consumption and time processing. Although some authors have also proposed compact representations, these drastically degrade the performance in a low dimension. Therefore in this work, we present different results of evaluating methods for producing compact embeddings in the context of sketch-based image retrieval. Our main interest is in strategies aiming to keep the local structure of the original space. The recent unsupervised local-topology preserving dimension reduction method UMAP fits our requirements and shows outstanding performance, improving even the precision achieved by SOTA methods. We evaluate six methods in two different datasets. We use Flickr15K and eCommerce datasets; the latter is another contribution of this work. We show that UMAP allows us to have feature vectors of 16 bytes improving precision by more than 35%.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionImage RetrievalRetrievalSketch-Based Image RetrievalSimilar Papers 제목 키워드 기반
Learning Barycentric Representations of 3D Shapes for Sketch-Based 3D Shape Retrieval
Retrieving 3D shapes with sketches is a challenging problem since 2D sketches and 3D shapes are from two heterogeneous domains, which results in large discrepancy between them. In this paper, we propose to learn barycent…
3D Shape Classification3D Shape RetrievalRetrievalACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrieval
The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{Z…
Image RetrievalRetrievalSketch-Based Image RetrievalSketchformer: Transformer-based Representation for Sketched Structure
Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks: sketch classification, sk…
Cross-Modal RetrievalDictionary LearningGeneral ClassificationImage Retrieval+2Deep Sketch-Shape Hashing With Segmented 3D Stochastic Viewing
Sketch-based 3D shape retrieval has been extensively studied in recent works, most of which focus on improving the retrieval accuracy, whilst neglecting the efficiency. In this paper, we propose a novel framework for eff…
3D Shape Classification3D Shape Representation3D Shape RetrievalRetrievalSketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval
We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were …
Deep HashingRetrievalSketch Recognition