LOH and behold: Web-scale visual search, recommendation and clustering using Locally Optimized Hashing
We propose a novel hashing-based matching scheme, called Locally Optimized Hashing (LOH), based on a state-of-the-art quantization algorithm that can be used for efficient, large-scale search, recommendation, clustering, and deduplication. We show that matching with LOH only requires set intersections and summations to compute and so is easily implemented in generic distributed computing systems. We further show application of LOH to: a) large-scale search tasks where performance is on par with other state-of-the-art hashing approaches; b) large-scale recommendation where queries consisting of thousands of images can be used to generate accurate recommendations from collections of hundreds of millions of images; and c) efficient clustering with a graph-based algorithm that can be scaled to massive collections in a distributed environment or can be used for deduplication for small collections, like search results, performing better than traditional hashing approaches while only requiring a few milliseconds to run. In this paper we experiment on datasets of up to 100 million images, but in practice our system can scale to larger collections and can be used for other types of data that have a vector representation in a Euclidean space.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDistributed ComputingQuantizationSimilar Papers 제목 키워드 기반
Clustering by Direct Optimization of the Medoid Silhouette
The evaluation of clustering results is difficult, highly dependent on the evaluated data set and the perspective of the beholder. There are many different clustering quality measures, which try to provide a general meas…
ClusteringMedoid Silhouette clustering with automatic cluster number selection
The evaluation of clustering results is difficult, highly dependent on the evaluated data set and the perspective of the beholder. There are many different clustering quality measures, which try to provide a general meas…
ClusteringStyle-based Clustering of Visual Artworks and the Play of Neural Style-Representations
Clustering artworks based on style can have many potential real-world applications like art recommendations, style-based search and retrieval, and the study of artistic style evolution of an artist or in an artwork corpu…
ClusteringStyle TransferIn the Eye of the Beholder: Gaze and Actions in First Person Video
We address the task of jointly determining what a person is doing and where they are looking based on the analysis of video captured by a headworn camera. To facilitate our research, we first introduce the EGTEA Gaze+ da…
Action RecognitionGaze Estimatione-CLIP: Large-Scale Vision-Language Representation Learning in E-commerce
Understanding vision and language representations of product content is vital for search and recommendation applications in e-commerce. As a backbone for online shopping platforms and inspired by the recent success in re…
AttributeAttribute ExtractionClusteringContrastive Learning+1