paper-with-me

Papers

Optimal Hashing-based Time-Space Trade-offs for Approximate Near Neighbors

2017-05-21 · Andoni Alexandr, Laarhoven Thijs, Razenshteyn Ilya, Waingarten Erik

[See the paper for the full abstract.] We show tight upper and lower bounds for time-space trade-offs for the $c$-Approximate Near Neighbor Search problem. For the $d$-dimensional Euclidean space and $n$-point datasets, we develop a data structure with space $n^{1 + \rho_u + o(1)} + O(dn)$ and query time $n^{\rho_q + o(1)} + d n^{o(1)}$ for every $\rho_u, \rho_q \geq 0$ such that: \begin{equation} c^2 \sqrt{\rho_q} + (c^2 - 1) \sqrt{\rho_u} = \sqrt{2c^2 - 1}. \end{equation} This is the first data structure that achieves sublinear query time and near-linear space for every approximation factor $c > 1$, improving upon [Kapralov, PODS 2015]. The data structure is a culmination of a long line of work on the problem for all space regimes; it builds on Spherical Locality-Sensitive Filtering [Becker, Ducas, Gama, Laarhoven, SODA 2016] and data-dependent hashing [Andoni, Indyk, Nguyen, Razenshteyn, SODA 2014] [Andoni, Razenshteyn, STOC 2015]. Our matching lower bounds are of two types: conditional and unconditional. First, we prove tightness of the whole above trade-off in a restricted model of computation, which captures all known hashing-based approaches. We then show unconditional cell-probe lower bounds for one and two probes that match the above trade-off for $\rho_q = 0$, improving upon the best known lower bounds from [Panigrahy, Talwar, Wieder, FOCS 2010]. In particular, this is the first space lower bound (for any static data structure) for two probes which is not polynomially smaller than the one-probe bound. To show the result for two probes, we establish and exploit a connection to locally-decodable codes.

📄 PDF Abstract BibTeX arXiv:1608.03580

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Falconn++: A Locality-sensitive Filtering Approach for Approximate Nearest Neighbor Search

2022-06-03 · Ninh Pham, Tao Liu

We present Falconn++, a novel locality-sensitive filtering approach for approximate nearest neighbor search on angular distance. Falconn++ can filter out potential far away points in any hash bucket \textit{before} query…

Hashing Hyperplane Queries to Near Points with Applications to Large-Scale Active Learning

2010-12-01 · NeurIPS 2010 12 · Prateek Jain, Sudheendra Vijayanarasimhan, Kristen Grauman

We consider the problem of retrieving the database points nearest to a given {\em hyperplane} query without exhaustively scanning the database. We propose two hashing-based solutions. Our first approach maps the data to …

Active Learning

MIHash: Online Hashing with Mutual Information

2017-03-27 · ICCV 2017 10 · Fatih Cakir, Kun He, Sarah Adel Bargal, Stan Sclaroff

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data.…

Image RetrievalRetrieval

Time-Space Tradeoffs for Learning from Small Test Spaces: Learning Low Degree Polynomial Functions

2017-08-08 · Paul Beame, Shayan Oveis Gharan, Xin Yang

We develop an extension of recently developed methods for obtaining time-space tradeoff lower bounds for problems of learning from random test samples to handle the situation where the space of tests is signficantly smal…

Utility-Fairness Trade-Offs and How to Find Them

2024-04-15 · CVPR 2024 1 · Sepehr Dehdashtian, Bashir Sadeghi, Vishnu Naresh Boddeti

When building classification systems with demographic fairness considerations, there are two objectives to satisfy: 1) maximizing utility for the specific task and 2) ensuring fairness w.r.t. a known demographic attribut…

AttributeFairnessRepresentation Learning