paper-with-me

Papers

Navigable Graphs for High-Dimensional Nearest Neighbor Search: Constructions and Limits

2024-05-29 · Haya Diwan, Jinrui Gou, Cameron Musco, Christopher Musco, Torsten Suel

There has been significant recent interest in graph-based nearest neighbor search methods, many of which are centered on the construction of navigable graphs over high-dimensional point sets. A graph is navigable if we can successfully move from any starting node to any target node using a greedy routing strategy where we always move to the neighbor that is closest to the destination according to a given distance function. The complete graph is navigable for any point set, but the important question for applications is if sparser graphs can be constructed. While this question is fairly well understood in low-dimensions, we establish some of the first upper and lower bounds for high-dimensional point sets. First, we give a simple and efficient way to construct a navigable graph with average degree $O(\sqrt{n \log n })$ for any set of $n$ points, in any dimension, for any distance function. We compliment this result with a nearly matching lower bound: even under the Euclidean metric in $O(\log n)$ dimensions, a random point set has no navigable graph with average degree $O(n^{\alpha})$ for any $\alpha < 1/2$. Our lower bound relies on sharp anti-concentration bounds for binomial random variables, which we use to show that the near-neighborhoods of a set of random points do not overlap significantly, forcing any navigable graph to have many edges.

📄 PDF Abstract BibTeX arXiv:2405.18680

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search

2025-05-21 · Yousef Al-Jazzazi, Haya Diwan, Jinrui Gou, Cameron Musco 외

Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirica…

Information Retrieval

Hybrid Approximate Nearest Neighbor Indexing and Search (HANNIS) for Large Descriptor Databases

2023-01-26 · IEEE International Conference on Big Data (Big Data) 2023 1 · M M Mahabubur Rahman, Jelena Tešić

In this paper, we present a novel method for efficient and effective retrieval of similar deep descriptors. Our new hybrid method for indexing and searching for the approximate nearest neighbors in high-dimensional large…

Retrieval

LANNS: A Web-Scale Approximate Nearest Neighbor Lookup System

2020-10-19 · Ishita Doshi, Dhritiman Das, Ashish Bhutani, Rajeev Kumar 외

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hie…

Information RetrievalPlaying the Game of 2048Retrieval

Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs

2016-03-30 · Yu. A. Malkov, D. A. Yashunin

We present a new approach for the approximate K-nearest neighbor search based on navigable small world graphs with controllable hierarchy (Hierarchical NSW, HNSW). The proposed solution is fully graph-based, without any …

Efficiently Constructing Sparse Navigable Graphs

2025-07-17 · Alex Conway, Laxman Dhulipala, Martin Farach-Colton, Rob Johnson 외

Graph-based nearest neighbor search methods have seen a surge of popularity in recent years, offering state-of-the-art performance across a wide variety of applications. Central to these methods is the task of constructi…

graph construction