paper-with-me

Papers

A Comprehensive Survey on Distributed Training of Graph Neural Networks

2022-11-10 · Haiyang Lin, Mingyu Yan, Xiaochun Ye, Dongrui Fan, Shirui Pan, WenGuang Chen, Yuan Xie

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most promising solution is distributed training which distributes the workload of training across multiple computing nodes. At present, the volume of related research on distributed GNN training is exceptionally vast, accompanied by an extraordinarily rapid pace of publication. Moreover, the approaches reported in these studies exhibit significant divergence. This situation poses a considerable challenge for newcomers, hindering their ability to grasp a comprehensive understanding of the workflows, computational patterns, communication strategies, and optimization techniques employed in distributed GNN training. As a result, there is a pressing need for a survey to provide correct recognition, analysis, and comparisons in this field. In this paper, we provide a comprehensive survey of distributed GNN training by investigating various optimization techniques used in distributed GNN training. First, distributed GNN training is classified into several categories according to their workflows. In addition, their computational patterns and communication patterns, as well as the optimization techniques proposed by recent work are introduced. Second, the software frameworks and hardware platforms of distributed GNN training are also introduced for a deeper understanding. Third, distributed GNN training is compared with distributed training of deep neural networks, emphasizing the uniqueness of distributed GNN training. Finally, interesting issues and opportunities in this field are discussed.

📄 PDF Abstract BibTeX arXiv:2211.05368

Code (0)

등록된 구현이 없습니다.

Tasks

Survey

Similar Papers 제목 키워드 기반

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations

2021-11-11 · Denis Kleyko, Dmitri A. Rachkovskij, Evgeny Osipov, Abbas Rahimi

This two-part comprehensive survey is devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computati…

Electrical EngineeringSurvey

Distributed Graph Neural Network Training: A Survey

2022-11-01 · Yingxia Shao, Hongzheng Li, Xizhi Gu, Hongbo Yin 외

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to eff…

CPUDistributed ComputingGPUGraph Neural Network+1

Out-Of-Distribution Generalization on Graphs: A Survey

2022-02-16 · Haoyang Li, Xin Wang, Ziwei Zhang, Wenwu Zhu

Graph machine learning has been extensively studied in both academia and industry. Although booming with a vast number of emerging methods and techniques, most of the literature is built on the in-distribution hypothesis…

Out-of-Distribution GeneralizationSurvey

A survey on secure decentralized optimization and learning

2024-08-16 · Changxin Liu, Nicola Bastianello, Wei Huo, Yang Shi 외

Decentralized optimization has become a standard paradigm for solving large-scale decision-making problems and training large machine learning models without centralizing data. However, this paradigm introduces new priva…

Decision MakingDistributed OptimizationPrivacy PreservingSurvey

Communication-Efficient Distributed Deep Learning: A Comprehensive Survey

2020-03-10 · Zhenheng Tang, Shaohuai Shi, Wei Wang, Bo Li 외

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is lim…

Deep LearningSurvey