paper-with-me

Papers

Clustering is Efficient for Approximate Maximum Inner Product Search

2015-07-21 · Alex Auvolat, Sarath Chandar, Pascal Vincent, Hugo Larochelle, Yoshua Bengio

Efficient Maximum Inner Product Search (MIPS) is an important task that has a wide applicability in recommendation systems and classification with a large number of classes. Solutions based on locality-sensitive hashing (LSH) as well as tree-based solutions have been investigated in the recent literature, to perform approximate MIPS in sublinear time. In this paper, we compare these to another extremely simple approach for solving approximate MIPS, based on variants of the k-means clustering algorithm. Specifically, we propose to train a spherical k-means, after having reduced the MIPS problem to a Maximum Cosine Similarity Search (MCSS). Experiments on two standard recommendation system benchmarks as well as on large vocabulary word embeddings, show that this simple approach yields much higher speedups, for the same retrieval precision, than current state-of-the-art hashing-based and tree-based methods. This simple method also yields more robust retrievals when the query is corrupted by noise.

📄 PDF Abstract BibTeX arXiv:1507.05910

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringRecommendation SystemsRetrievalWord Embeddings

Methods 이 논문이 사용한 방법론

k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…

Similar Papers 제목 키워드 기반

Optimistic Query Routing in Clustering-based Approximate Maximum Inner Product Search

2024-05-20 · Sebastian Bruch, Aditya Krishnan, Franco Maria Nardini

Clustering-based nearest neighbor search is an effective method in which points are partitioned into geometric shards to form an index, with only a few shards searched during query processing to find a set of top-$k$ vec…

ClusteringSequential Decision Making

Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)

2014-05-22 · NeurIPS 2014 12 · Anshumali Shrivastava, Ping Li

We present the first provably sublinear time algorithm for approximate \emph{Maximum Inner Product Search} (MIPS). Our proposal is also the first hashing algorithm for searching with (un-normalized) inner product as the …

Collaborative Filtering

Improved Asymmetric Locality Sensitive Hashing (ALSH) for Maximum Inner Product Search (MIPS)

2014-10-20 · Anshumali Shrivastava, Ping Li

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS whic…

Möbius Transformation for Fast Inner Product Search on Graph

2019-12-01 · NeurIPS 2019 12 · Zhixin Zhou, Shulong Tan, Zhaozhuo Xu, Ping Li

We present a fast search on graph algorithm for Maximum Inner Product Search (MIPS). This optimization problem is challenging since traditional Approximate Nearest Neighbor (ANN) search methods may not perform efficientl…

Learning Cluster Representatives for Approximate Nearest Neighbor Search

2024-12-08 · Thomas Vecchiato

Developing increasingly efficient and accurate algorithms for approximate nearest neighbor search is a paramount goal in modern information retrieval. A primary approach to addressing this question is clustering, which i…

ClusteringInformation RetrievalLearning-To-Rank