paper-with-me

홈 › Papers

New Loss Functions for Fast Maximum Inner Product Search

2020-01-01 · ICLR 2020 1 · Ruiqi Guo, Quan Geng, David Simcha, Felix Chern, Phil Sun, Sanjiv Kumar

Quantization based methods are popular for solving large scale maximum inner product search problems. However, in most traditional quantization works, the objective is to minimize the reconstruction error for datapoints to be searched. In this work, we focus directly on minimizing error in inner product approximation and derive a new class of quantization loss functions. One key aspect of the new loss functions is that we weight the error term based on the value of the inner product, giving more importance to pairs of queries and datapoints whose inner products are high. We provide theoretical grounding to the new quantization loss function, which is simple, intuitive and able to work with a variety of quantization techniques, including binary quantization and product quantization. We conduct experiments on public benchmarking datasets \url{http://ann-benchmarks.com} to demonstrate that our method using the new objective outperforms other state-of-the-art methods. We are committed to release our source code.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingQuantization

Similar Papers 제목 키워드 기반

Accelerating Large-Scale Inference with Anisotropic Vector Quantization

2019-08-27 · ICML 2020 1 · Ruiqi Guo, Philip Sun, Erik Lindgren, Quan Geng 외

Quantization based techniques are the current state-of-the-art for scaling maximum inner product search to massive databases. Traditional approaches to quantization aim to minimize the reconstruction error of the databas…

BenchmarkingQuantization

Learning Binary Codes for Maximum Inner Product Search

2015-12-01 · ICCV 2015 12 · Fumin Shen, Wei Liu, Shaoting Zhang, Yang Yang 외

Binary coding or hashing techniques are recognized to accomplish efficient near neighbor search, and have thus attracted broad interests in the recent vision and learning studies. However, such studies have rarely been d…

Möbius Transformation for Fast Inner Product Search on Graph

2019-12-01 · NeurIPS 2019 12 · Zhixin Zhou, Shulong Tan, Zhaozhuo Xu, Ping Li

We present a fast search on graph algorithm for Maximum Inner Product Search (MIPS). This optimization problem is challenging since traditional Approximate Nearest Neighbor (ANN) search methods may not perform efficientl…

Reinforcement Routing on Proximity Graph for Efficient Recommendation

2022-01-23 · Chao Feng, Defu Lian, Xiting Wang, Zheng Liu 외

We focus on Maximum Inner Product Search (MIPS), which is an essential problem in many machine learning communities. Given a query, MIPS finds the most similar items with the maximum inner products. Methods for Nearest N…

Imitation LearningRecommendation Systems

Quantization based Fast Inner Product Search

2015-09-04 · Ruiqi Guo, Sanjiv Kumar, Krzysztof Choromanski, David Simcha

We propose a quantization based approach for fast approximate Maximum Inner Product Search (MIPS). Each database vector is quantized in multiple subspaces via a set of codebooks, learned directly by minimizing the inner …

Quantization