paper-with-me

Papers

Characterizing and Understanding Distributed GNN Training on GPUs

2022-04-18 · Haiyang Lin, Mingyu Yan, Xiaocheng Yang, Mo Zou, WenMing Li, Xiaochun Ye, Dongrui Fan

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which accelerates training using multiple computing nodes. Maximizing the performance is essential, but the execution of distributed GNN training remains preliminarily understood. In this work, we provide an in-depth analysis of distributed GNN training on GPUs, revealing several significant observations and providing useful guidelines for both software optimization and hardware optimization.

📄 PDF Abstract BibTeX arXiv:2204.08150

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Similar Papers 제목 키워드 기반

Characterizing and Understanding HGNN Training on GPUs

2024-07-16 · Dengke Han, Mingyu Yan, Xiaochun Ye, Dongrui Fan

Owing to their remarkable representation capabilities for heterogeneous graph data, Heterogeneous Graph Neural Networks (HGNNs) have been widely adopted in many critical real-world domains such as recommendation systems …

GPURecommendation Systems

Characterizing the Efficiency of Distributed Training: A Power, Performance, and Thermal Perspective

2025-09-12 · Seokjin Go, Joongun Park, Spandan More, Hanjiang Wu 외 arxiv

The rapid scaling of Large Language Models (LLMs) has pushed training workloads far beyond the limits of single-node analysis, demanding a deeper understanding of how these models behave across large-scale, multi-GPU sys…

Theano-MPI: a Theano-based Distributed Training Framework

2016-05-26 · He Ma, Fei Mao, Graham W. Taylor

We develop a scalable and extendable training framework that can utilize GPUs across nodes in a cluster and accelerate the training of deep learning models based on data parallelism. Both synchronous and asynchronous tra…

Deep Learning

DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames

2019-11-01 · ICLR 2020 1 · Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee 외

We present Decentralized Distributed Proximal Policy Optimization (DD-PPO), a method for distributed reinforcement learning in resource-intensive simulated environments. DD-PPO is distributed (uses multiple machines), de…

Autonomous NavigationGPUNavigatePointGoal Navigation+3

DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training

2023-04-17 · CVPR 2023 1 · Yihao Chen, Xianbiao Qi, Jianan Wang, Lei Zhang

We propose DisCo-CLIP, a distributed memory-efficient CLIP training approach, to reduce the memory consumption of contrastive loss when training contrastive learning models. Our approach decomposes the contrastive loss a…

Contrastive LearningGPU