Exploiting Modern Hardware for High-Dimensional Nearest Neighbor Search
Many multimedia information retrieval or machine learning problems require efficient high-dimensional nearest neighbor search techniques. For instance, multimedia objects (images, music or videos) can be represented by high-dimensional feature vectors. Finding two similar multimedia objects then comes down to finding two objects that have similar feature vectors. In the current context of mass use of social networks, large scale multimedia databases or large scale machine learning applications are more and more common, calling for efficient nearest neighbor search approaches. This thesis builds on product quantization, an efficient nearest neighbor search technique that compresses high-dimensional vectors into short codes. This makes it possible to store very large databases entirely in RAM, enabling low response times. We propose several contributions that exploit the capabilities of modern CPUs, especially SIMD and the cache hierarchy, to further decrease response times offered by product quantization.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningInformation RetrievalQuantizationRetrievalVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Utilizing Low-Dimensional Molecular Embeddings for Rapid Chemical Similarity Search
Nearest neighbor-based similarity searching is a common task in chemistry, with notable use cases in drug discovery. Yet, some of the most commonly used approaches for this task still leverage a brute-force approach. In …
CPUDrug DiscoveryPanorama: Fast-Track Nearest Neighbors
Approximate Nearest-Neighbor Search (ANNS) pipelines for high-dimensional neural embeddings spend the bulk of their query time in candidate verification, making it the primary bottleneck in the search process. In this pa…
Nearest-Neighbor Radii under Dependent Sampling
Nearest-neighbor methods are fundamental to classical and modern machine learning, yet their geometric properties are typically analyzed under independent sampling. In this paper, we study the nearest-neighbor radii unde…
Approximate Nearest Neighbor Search for Modern AI: A Projection-Augmented Graph Approach
Approximate Nearest Neighbor Search (ANNS) is fundamental to modern AI applications. Most existing solutions optimize query efficiency but fail to align with the practical requirements of modern workloads. In this paper,…
FANNG: Fast Approximate Nearest Neighbour Graphs
We present a new method for approximate nearest neighbour search on large datasets of high dimensional feature vectors, such as SIFT or GIST descriptors. Our approach constructs a directed graph that can be efficiently …
GPU