paper-with-me

홈 › Papers

Scaling Graph Neural Networks with Approximate PageRank

2020-07-03 · Aleksandar Bojchevski, Johannes Gasteiger, Bryan Perozzi, Amol Kapoor, Martin Blais, Benedek Rózemberczki, Michal Lukasik, Stephan Günnemann

Graph neural networks (GNNs) have emerged as a powerful approach for solving many network mining tasks. However, learning on large graphs remains a challenge - many recently proposed scalable GNN approaches rely on an expensive message-passing procedure to propagate information through the graph. We present the PPRGo model which utilizes an efficient approximation of information diffusion in GNNs resulting in significant speed gains while maintaining state-of-the-art prediction performance. In addition to being faster, PPRGo is inherently scalable, and can be trivially parallelized for large datasets like those found in industry settings. We demonstrate that PPRGo outperforms baselines in both distributed and single-machine training environments on a number of commonly used academic graphs. To better analyze the scalability of large-scale graph learning methods, we introduce a novel benchmark graph with 12.4 million nodes, 173 million edges, and 2.8 million node features. We show that training PPRGo from scratch and predicting labels for all nodes in this graph takes under 2 minutes on a single machine, far outpacing other baselines on the same graph. We discuss the practical application of PPRGo to solve large-scale node classification problems at Google.

📄 PDF Abstract BibTeX arXiv:2007.01570

Code (2)

TUM-DAML/pprgo_tensorflow 공식 구현 tf
TUM-DAML/pprgo_pytorch pytorch

Tasks

Graph LearningNode Classification

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Statistical guarantees for local graph clustering

2019-06-11 · Wooseok Ha, Kimon Fountoulakis, Michael W. Mahoney

Local graph clustering methods aim to find small clusters in very large graphs. These methods take as input a graph and a seed node, and they return as output a good cluster in a running time that depends on the size of …

ClusteringGraph Clustering

Improved Communication Cost in Distributed PageRank Computation – A Theoretical Study

2020-01-01 · ICML 2020 1 · Siqiang Luo

PageRank is a widely used approach for measuring the importance of a node in a graph. Computing PageRank is a fundamental task in numerous applications including web search, machine learning and recommendation systems. T…

Recommendation Systems

Scaling Up Graph Propagation Computation on Large Graphs: A Local Chebyshev Approximation Approach

2024-12-14 · Yichun Yang, Rong-Hua Li, Meihao Liao, Longlong Lin 외

Graph propagation (GP) computation plays a crucial role in graph data analysis, supporting various applications such as graph node similarity queries, graph node ranking, graph clustering, and graph neural networks. Exis…

Graph Clustering

Integrating Personalized PageRank into Neural Word Sense Disambiguation

2021-11-01 · EMNLP 2021 11 · Ahmed El Sheikh, Michele Bevilacqua, Roberto Navigli

Neural Word Sense Disambiguation (WSD) has recently been shown to benefit from the incorporation of pre-existing knowledge, such as that coming from the WordNet graph. However, state-of-the-art approaches have been succe…

Word Sense Disambiguation

Improving Graph Neural Networks at Scale: Combining Approximate PageRank and CoreRank

2022-11-08 · Ariel R. Ramos Vela, Johannes F. Lutzeyer, Anastasios Giovanidis, Michalis Vazirgiannis

Graph Neural Networks (GNNs) have achieved great successes in many learning tasks performed on graph structures. Nonetheless, to propagate information GNNs rely on a message passing scheme which can become prohibitively …