paper-with-me

Papers

NodeSketch: Highly-Efficient Graph Embeddings via Recursive Sketching

2020-05-13 · ‏‏‎ ‎ 2020 5 · Dingqi Yang, Paolo Rosso, Bin Li, Philippe Cudre-Mauroux

Embeddings have become a key paradigm to learn graph represen-tations and facilitate downstream graph analysis tasks. Existinggraph embedding techniques either sample a large number of nodepairs from a graph to learn node embeddings via stochastic op-timization, or factorize a high-order proximity/adjacency matrixof the graph via expensive matrix factorization. However, thesetechniques usually require significant computational resources forthe learning process, which hinders their applications on large-scale graphs. Moreover, the cosine similarity preserved by thesetechniques shows suboptimal efficiency in downstream graph anal-ysis tasks, compared to Hamming similarity, for example. To ad-dress these issues, we propose NodeSketch, a highly-efficient graphembedding technique preserving high-order node proximity viarecursive sketching. Specifically, built on top of an efficient data-independent hashing/sketching technique, NodeSketch generatesnode embeddings in Hamming space. For an input graph, it starts bysketching the self-loop-augmented adjacency matrix of the graphto output low-order node embeddings, and then recursively gener-atesk-order node embeddings based on the self-loop-augmentedadjacency matrix and (k-1)-order node embeddings. Our extensiveevaluation compares NodeSketch against a sizable collection ofstate-of-the-art techniques using five real-world graphs on twograph analysis tasks. The results show that NodeSketch achievesstate-of-the-art performance compared to these techniques, whileshowing significant speedup of 9x-372x in the embedding learningprocess and 1.19x-1.68x speedup when performing downstreamgraph analysis tasks

📄 PDF Abstract BibTeX

Code (2)

eXascaleInfolab/NodeSketch 공식 구현
benedekrozemberczki/karateclub

Similar Papers 제목 키워드 기반

How does the Mind store Information?

2019-10-03 · Rina Panigrahy

How we store information in our mind has been a major intriguing open question. We approach this question not from a physiological standpoint as to how information is physically stored in the brain, but from a conceptual…

Open-Ended Question Answering

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

2024-06-08 · Yurui Lai, Xiaoyang Lin, Renchi Yang, Hongtao Wang

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, whe…

AttributeData AugmentationNode Classification

Recursive Importance Sketching for Rank Constrained Least Squares: Algorithms and High-order Convergence

2020-11-17 · Yuetian Luo, Wen Huang, Xudong Li, Anru R. Zhang

In this paper, we propose {\it \underline{R}ecursive} {\it \underline{I}mportance} {\it \underline{S}ketching} algorithm for {\it \underline{R}ank} constrained least squares {\it \underline{O}ptimization} (RISRO). The ke…

Retrieval

Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms

2024-04-01 · Leda Wang, Zhixiang Zhang, Edgar Dobriban

Randomized algorithms can be used to speed up the analysis of large datasets. In this paper, we develop a unified methodology for statistical inference via randomized sketching or projections in two of the most fundament…

Hierarchical Character Embeddings: Learning Phonological and Semantic Representations in Languages of Logographic Origin using Recursive Neural Networks

2019-12-20 · Minh Nguyen, Gia H. Ngo, Nancy F. Chen

Logographs (Chinese characters) have recursive structures (i.e. hierarchies of sub-units in logographs) that contain phonological and semantic information, as developmental psychology literature suggests that native spea…

DiagnosticLanguage ModelingLanguage Modelling