paper-with-me

Papers

Compact and Effective Representations for Sketch-based Image Retrieval

2021-04-20 · Pablo Torres, Jose M. Saavedra

Sketch-based image retrieval (SBIR) has undergone an increasing interest in the community of computer vision bringing high impact in real applications. For instance, SBIR brings an increased benefit to eCommerce search engines because it allows users to formulate a query just by drawing what they need to buy. However, current methods showing high precision in retrieval work in a high dimensional space, which negatively affects aspects like memory consumption and time processing. Although some authors have also proposed compact representations, these drastically degrade the performance in a low dimension. Therefore in this work, we present different results of evaluating methods for producing compact embeddings in the context of sketch-based image retrieval. Our main interest is in strategies aiming to keep the local structure of the original space. The recent unsupervised local-topology preserving dimension reduction method UMAP fits our requirements and shows outstanding performance, improving even the precision achieved by SOTA methods. We evaluate six methods in two different datasets. We use Flickr15K and eCommerce datasets; the latter is another contribution of this work. We show that UMAP allows us to have feature vectors of 16 bytes improving precision by more than 35%.

📄 PDF Abstract BibTeX arXiv:2104.10278

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionImage RetrievalRetrievalSketch-Based Image Retrieval

Similar Papers 제목 키워드 기반

Learning Barycentric Representations of 3D Shapes for Sketch-Based 3D Shape Retrieval

2017-07-01 · CVPR 2017 7 · Jin Xie, Guoxian Dai, Fan Zhu, Yi Fang

Retrieving 3D shapes with sketches is a challenging problem since 2D sketches and 3D shapes are from two heterogeneous domains, which results in large discrepancy between them. In this paper, we propose to learn barycent…

3D Shape Classification3D Shape RetrievalRetrieval

ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrieval

2021-11-24 · Hao Ren, Ziqiang Zheng, Yang Wu, Hong Lu 외

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{Z…

Image RetrievalRetrievalSketch-Based Image Retrieval

Sketchformer: Transformer-based Representation for Sketched Structure

2020-02-24 · CVPR 2020 6 · Leo Sampaio Ferraz Ribeiro, Tu Bui, John Collomosse, Moacir Ponti

Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks: sketch classification, sk…

Cross-Modal RetrievalDictionary LearningGeneral ClassificationImage Retrieval+2

Deep Sketch-Shape Hashing With Segmented 3D Stochastic Viewing

2019-06-01 · CVPR 2019 6 · Jiaxin Chen, Jie Qin, Li Liu, Fan Zhu 외

Sketch-based 3D shape retrieval has been extensively studied in recent works, most of which focus on improving the retrieval accuracy, whilst neglecting the efficiency. In this paper, we propose a novel framework for eff…

3D Shape Classification3D Shape Representation3D Shape RetrievalRetrieval

SketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval

2018-04-04 · CVPR 2018 6 · Peng Xu, Yongye Huang, Tongtong Yuan, Kaiyue Pang 외

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were …

Deep HashingRetrievalSketch Recognition