Graph-based Nearest Neighbor Search in Hyperbolic Spaces
The nearest neighbor search (NNS) problem is widely studied in Euclidean space, and graph-based algorithms are known to outperform other approaches for this task. However, hyperbolic geometry is found to be very useful for data representation in various domains, including natural language processing, computer vision, and information retrieval. In this paper, we show that graph-based approaches are also well suited for hyperbolic geometry. From a theoretical perspective, we rigorously analyze the time and space complexity of graph-based NNS, assuming that an n-element dataset is uniformly distributed within a d-dimensional ball of radius R in the hyperbolic space of curvature -1. Assuming the dense setting (d << log(n)), we derive the time and space complexity of graph-based NNS and compare the obtained results with known guarantees for the Euclidean case. Interestingly, under some assumptions on dimension d and radius R, graph-based NNS has lower time complexity in the hyperbolic space. From a practical perspective, we illustrate this result on word embedding data: we compare graph-based NNS for GloVe and Poincare GloVe word embeddings. It turns out that for the same corpus, graph-based NNS is more efficient in the hyperbolic space. We also demonstrate that graph-based methods outperform other existing baselines on Poincare GloVe word embeddings. Overall, our theoretical and empirical analysis suggests that graph-based NNS can be considered a default approach for similarity search in hyperbolic spaces.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalRetrievalWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Hyperbolic-to-Hyperbolic Graph Convolutional Network
Hyperbolic graph convolutional networks (GCNs) demonstrate powerful representation ability to model graphs with hierarchical structure. Existing hyperbolic GCNs resort to tangent spaces to realize graph convolution on hy…
General ClassificationGraph ClassificationLink PredictionNode ClassificationHLoOP -- Hyperbolic 2-space Local Outlier Probabilities
Hyperbolic geometry has recently garnered considerable attention in machine learning due to its capacity to embed hierarchical graph structures with low distortions for further downstream processing. This paper introduce…
Outlier DetectionNeighborhood Growth Determines Geometric Priors for Relational Representation Learning
The problem of identifying geometric structure in heterogeneous, high-dimensional data is a cornerstone of representation learning. While there exists a large body of literature on the embeddability of canonical graphs, …
Representation LearningHyperbolic Graph Attention Network
Graph neural network (GNN) has shown superior performance in dealing with graphs, which has attracted considerable research attention recently. However, most of the existing GNN models are primarily designed for graphs i…
AnatomyGraph AttentionGraph Neural NetworkApproximate k-NN Graph Construction: a Generic Online Approach
Nearest neighbor search and k-nearest neighbor graph construction are two fundamental issues arise from many disciplines such as multimedia information retrieval, data-mining and machine learning. They become more and mo…
graph constructionInformation RetrievalRetrieval