paper-with-me

홈 › Papers

LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation

2023-02-03 · Rui Xue, Haoyu Han, MohamadAli Torkamani, Jian Pei, Xiaorui Liu

Recent works have demonstrated the benefits of capturing long-distance dependency in graphs by deeper graph neural networks (GNNs). But deeper GNNs suffer from the long-lasting scalability challenge due to the neighborhood explosion problem in large-scale graphs. In this work, we propose to capture long-distance dependency in graphs by shallower models instead of deeper models, which leads to a much more efficient model, LazyGNN, for graph representation learning. Moreover, we demonstrate that LazyGNN is compatible with existing scalable approaches (such as sampling methods) for further accelerations through the development of mini-batch LazyGNN. Comprehensive experiments demonstrate its superior prediction performance and scalability on large-scale benchmarks. The implementation of LazyGNN is available at https://github.com/RXPHD/Lazy_GNN.

📄 PDF Abstract BibTeX arXiv:2302.01503

Code (1)

rxphd/lazy_gnn 공식 구현 pytorch

Tasks

Graph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Lazy learning: a biologically-inspired plasticity rule for fast and energy efficient synaptic plasticity

2023-03-26 · Aaron Pache, Mark CW van Rossum

When training neural networks for classification tasks with backpropagation, parameters are updated on every trial, even if the sample is classified correctly. In contrast, humans concentrate their learning effort on err…

IGLU: Efficient GCN Training via Lazy Updates

2021-09-28 · ICLR 2022 4 · S Deepak Narayanan, Aditya Sinha, Prateek Jain, Purushottam Kar 외

Training multi-layer Graph Convolution Networks (GCN) using standard SGD techniques scales poorly as each descent step ends up updating node embeddings for a large portion of the graph. Recent attempts to remedy this sub…

Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression

2025-09-23 · Boao Kong, Xu Huang, Yuqi Xu, Yixuan Liang 외 arxiv

Pipeline-parallel distributed optimization is essential for large-scale machine learning but is challenged by significant communication overhead from transmitting high-dimensional activations and gradients between worker…

Distributed Optimization

Lazy-CFR: fast and near-optimal regret minimization for extensive games with imperfect information

2020-05-01 · ICLR 2020 1 · Yichi Zhou, Tongzheng Ren, Jialian Li, Dong Yan 외

Counterfactual regret minimization (CFR) methods are effective for solving two-player zero-sum extensive games with imperfect information with state-of-the-art results. However, the vanilla CFR has to traverse the who…

counterfactual

Lazy stochastic principal component analysis

2017-09-21 · Michael Wojnowicz, Dinh Nguyen, Li Li, Xuan Zhao

Stochastic principal component analysis (SPCA) has become a popular dimensionality reduction strategy for large, high-dimensional datasets. We derive a simplified algorithm, called Lazy SPCA, which has reduced computatio…

Dimensionality Reduction