paper-with-me

홈 › Papers

Non-metric Similarity Graphs for Maximum Inner Product Search

2018-12-01 · NeurIPS 2018 12 · Stanislav Morozov, Artem Babenko

In this paper we address the problem of Maximum Inner Product Search (MIPS) that is currently the computational bottleneck in a large number of machine learning applications. While being similar to the nearest neighbor search (NNS), the MIPS problem was shown to be more challenging, as the inner product is not a proper metric function. We propose to solve the MIPS problem with the usage of similarity graphs, i.e., graphs where each vertex is connected to the vertices that are the most similar in terms of some similarity function. Originally, the framework of similarity graphs was proposed for metric spaces and in this paper we naturally extend it to the non-metric MIPS scenario. We demonstrate that, unlike existing approaches, similarity graphs do not require any data transformation to reduce MIPS to the NNS problem and should be used for the original data. Moreover, we explain why such a reduction is detrimental for similarity graphs. By an extensive comparison to the existing approaches, we show that the proposed method is a game-changer in terms of the runtime/accuracy trade-off for the MIPS problem.

📄 PDF Abstract BibTeX

Code (1)

stanis-morozov/ip-nsw 공식 구현

Similar Papers 제목 키워드 기반

Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)

2014-05-22 · NeurIPS 2014 12 · Anshumali Shrivastava, Ping Li

We present the first provably sublinear time algorithm for approximate \emph{Maximum Inner Product Search} (MIPS). Our proposal is also the first hashing algorithm for searching with (un-normalized) inner product as the …

Collaborative Filtering

Möbius Transformation for Fast Inner Product Search on Graph

2019-12-01 · NeurIPS 2019 12 · Zhixin Zhou, Shulong Tan, Zhaozhuo Xu, Ping Li

We present a fast search on graph algorithm for Maximum Inner Product Search (MIPS). This optimization problem is challenging since traditional Approximate Nearest Neighbor (ANN) search methods may not perform efficientl…

On Efficient Retrieval of Top Similarity Vectors

2019-11-01 · IJCNLP 2019 11 · Shulong Tan, Zhixin Zhou, Zhaozhuo Xu, Ping Li

Retrieval of relevant vectors produced by representation learning critically influences the efficiency in natural language processing (NLP) tasks. In this paper, we demonstrate an efficient method for searching vectors v…

BIG-bench Machine LearningRepresentation LearningRetrieval

Improved Asymmetric Locality Sensitive Hashing (ALSH) for Maximum Inner Product Search (MIPS)

2014-10-20 · Anshumali Shrivastava, Ping Li

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS whic…

Learning-based Efficient Graph Similarity Computation via Multi-Scale Convolutional Set Matching

2018-09-10 · Yunsheng Bai, Hao Ding, Yizhou Sun, Wei Wang

Graph similarity computation is one of the core operations in many graph-based applications, such as graph similarity search, graph database analysis, graph clustering, etc. Since computing the exact distance/similarity …

ClusteringCombinatorial OptimizationGraph ClassificationGraph Clustering+3