paper-with-me

Papers

Polytopes, lattices, and spherical codes for the nearest neighbor problem

2019-07-10 · Thijs Laarhoven

We study locality-sensitive hash methods for the nearest neighbor problem for the angular distance, focusing on the approach of first projecting down onto a low-dimensional subspace, and then partitioning the projected vectors according to Voronoi cells induced by a suitable spherical code. This approach generalizes and interpolates between the fast but suboptimal hyperplane hashing of Charikar [STOC'02] and the asymptotically optimal but practically often slower hash families of Andoni-Indyk [FOCS'06], Andoni-Indyk-Nguyen-Razenshteyn [SODA'14] and Andoni-Indyk-Laarhoven-Razenshteyn-Schmidt [NIPS'15]. We set up a framework for analyzing the performance of any spherical code in this context, and we provide results for various codes from the literature, such as those related to regular polytopes and root lattices. Similar to hyperplane hashing, and unlike cross-polytope hashing, our analysis of collision probabilities and query exponents is exact and does not hide order terms which vanish only for large $d$, facilitating an easy parameter selection. For the two-dimensional case, we derive closed-form expressions for arbitrary spherical codes, and we show that the equilateral triangle is optimal, achieving a better performance than the two-dimensional analogues of hyperplane and cross-polytope hashing. In three and four dimensions, we numerically find that the tetrahedron, $5$-cell, and $16$-cell achieve the best query exponents, while in five or more dimensions orthoplices appear to outperform regular simplices, as well as the root lattice families $A_k$ and $D_k$. We argue that in higher dimensions, larger spherical codes will likely exist which will outperform orthoplices in theory, and we argue why using the $D_k$ root lattices will likely lead to better results in practice, due to a better trade-off between the asymptotic query exponent and the concrete costs of hashing.

📄 PDF Abstract BibTeX arXiv:1907.04628

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Neighborhood Growth Determines Geometric Priors for Relational Representation Learning

2019-10-12 · Melanie Weber

The problem of identifying geometric structure in heterogeneous, high-dimensional data is a cornerstone of representation learning. While there exists a large body of literature on the embeddability of canonical graphs, …

Representation Learning

Spherical Leech Quantization for Visual Tokenization and Generation

2025-12-16 · Yue Zhao, Hanwen Jiang, Zhenlin Xu, Chutong Yang 외 arxiv

Non-parametric quantization has received much attention due to its efficiency on parameters and scalability to a large codebook. In this paper, we present a unified formulation of different non-parametric quantization me…

Image Generation

Nearest Neighbor Representations of Neural Circuits

2024-02-13 · Kordag Mehmet Kilic, Jin Sima, Jehoshua Bruck

Neural networks successfully capture the computational power of the human brain for many tasks. Similarly inspired by the brain architecture, Nearest Neighbor (NN) representations is a novel approach of computation. We e…

K-Nearest Neighbors Hashing

2019-06-01 · CVPR 2019 6 · Xiangyu He, Peisong Wang, Jian Cheng

Hashing based approximate nearest neighbor search embeds high dimensional data to compact binary codes, which enables efficient similarity search and storage. However, the non-isometry sign() function makes it hard to pr…

Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods

2018-08-01 · Hugues Thomas, Jean-Emmanuel Deschaud, Beatriz Marcotegui, François Goulette 외

This paper introduces a new definition of multiscale neighborhoods in 3D point clouds. This definition, based on spherical neighborhoods and proportional subsampling, allows the computation of features with a consistent …

ClassificationGeneral ClassificationSemantic Segmentation