paper-with-me

Papers

Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor Search

2023-10-31 · Naoki Ono, Yusuke Matsui

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets. However, graph-based methods have the disadvantage of long index construction time. Recently, many researchers have improved the tradeoff between accuracy and speed during a search. However, there is little research on accelerating index construction. We propose a fast graph construction algorithm, Relative NN-Descent (RNN-Descent). RNN-Descent combines NN-Descent, an algorithm for constructing approximate K-nearest neighbor graphs (K-NN graphs), and RNG Strategy, an algorithm for selecting edges effective for search. This algorithm allows the direct construction of graph-based indexes without ANNS. Experimental results demonstrated that the proposed method had the fastest index construction speed, while its search performance is comparable to existing state-of-the-art methods such as NSG. For example, in experiments on the GIST1M dataset, the construction of the proposed method is 2x faster than NSG. Additionally, it was even faster than the construction speed of NN-Descent.

📄 PDF Abstract BibTeX arXiv:2310.20419

Code (1)

mti-lab/rnn-descent 공식 구현

Tasks

graph construction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Fast k-NN Graph Construction by GPU based NN-Descent

2021-10-30 · CIKM '21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management 2021 10 · Hui Wang, Wan-Lei Zhao, Xiangxiang Zeng, Jianye Yang

NN-Descent is a classic k-NN graph construction approach. It is still widely employed in machine learning, computer vision, and information retrieval tasks due to its efficiency and genericness. However, the current desi…

CPUGPUgraph constructionInformation Retrieval+1

Large-Scale Approximate k-NN Graph Construction on GPU

2021-03-29 · Hui Wang, Wan-Lei Zhao, Xiangxiang Zeng

k-nearest neighbor graph is a key data structure in many disciplines such as manifold learning, machine learning and information retrieval, etc. NN-Descent was proposed as an effective solution for the graph construction…

GPUgraph constructionInformation RetrievalRetrieval

Accurate and Fast Retrieval for Complex Non-metric Data via Neighborhood Graphs

2019-10-08 · Leonid Boytsov, Eric Nyberg

We demonstrate that a graph-based search algorithm-relying on the construction of an approximate neighborhood graph-can directly work with challenging non-metric and/or non-symmetric distances without resorting to metric…

graph constructionRetrieval

Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graph

2017-07-01 · Cong Fu, Chao Xiang, Changxu Wang, Deng Cai

Approximate nearest neighbor search (ANNS) is a fundamental problem in databases and data mining. A scalable ANNS algorithm should be both memory-efficient and fast. Some early graph-based approaches have shown attractiv…

Gradient Descent Efficiency Index

2024-10-25 · Aviral Dhingra

Gradient descent is a widely used iterative algorithm for finding local minima in multivariate functions. However, the final iterations often either overshoot the minima or make minimal progress, making it challenging to…