paper-with-me

홈 › Papers

Seastar: vertex-centric programming for graph neural networks

2021-04-21 · Proceedings of the Sixteenth European Conference on Computer Systems 2021 4 · Yidi Wu, Kaihao Ma, Zhenkun Cai, Tatiana Jin, Boyang Li, Chenguang Zheng, James Cheng, Fan Yu

Graph neural networks (GNNs) have achieved breakthrough performance in graph analytics such as node classification, link prediction and graph clustering. Many GNN training frameworks have been developed, but they are usually designed as a set of manually written, GNN-specific operators plugged into existing deep learning systems, which incurs high memory consumption, poor data locality, and large semantic gap between algorithm design and implementation. This paper proposes the Seastar system, which presents a vertex-centric programming model for GNN training on GPU and provides idiomatic python constructs to enable easy development of novel homogeneous and heterogeneous GNN models. We also propose novel optimizations to produce highly efficient fused GPU kernels for forward and backward passes in GNN training. Compared with the state-of-the art GNN systems, DGL and PyG, Seastar achieves better usability, up to 2 and 8 times less memory consumption, and 14 and 3 times faster execution, respectively.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

GPUGraph ClusteringLink PredictionNode Classification

Similar Papers 제목 키워드 기반

Vertex-Centric Visual Programming for Graph Neural Networks

2021-06-09 · Proceedings of the 2021 International Conference on Management of Data 2021 6 · Yidi Wu, Yuntao Gui, Tatiana Jin, James Cheng 외

Graph neural networks (GNNs) have achieved remarkable performance in many graph analytics tasks such as node classification, link prediction and graph clustering. Existing GNN systems (e.g., PyG and DGL) adopt a tensor-c…

Graph ClusteringLink PredictionNode Classification

Cavs: A Vertex-centric Programming Interface for Dynamic Neural Networks

2017-12-11 · Hao Zhang, Shizhen Xu, Graham Neubig, Wei Dai 외

Recent deep learning (DL) models have moved beyond static network architectures to dynamic ones, handling data where the network structure changes every example, such as sequences of variable lengths, trees, and graphs. …

Dynamic neural networksgraph constructionManagementScheduling

Rhizomes and Diffusions for Processing Highly Skewed Graphs on Fine-Grain Message-Driven Systems

2024-02-08 · Bibrak Qamar Chandio, Prateek Srivastava, Maciej Brodowicz, Martin Swany 외

The paper provides a unified co-design of 1) a programming and execution model that allows spawning tasks from within the vertex data at runtime, 2) language constructs for \textit{actions} that send work to where the da…

A Hypergraph-Partitioned Vertex Programming Approach for Large-scale Consensus Optimization

2013-08-30 · Hui Miao, Xiangyang Liu, Bert Huang, Lise Getoor

In modern data science problems, techniques for extracting value from big data require performing large-scale optimization over heterogenous, irregularly structured data. Much of this data is best represented as multi-re…

hypergraph partitioning

VMap: An Interactive Rectangular Space-filling Visualization for Map-like Vertex-centric Graph Exploration

2023-05-31 · Jiayi Xu, Han-Wei Shen

We present VMap, a map-like rectangular space-filling visualization, to perform vertex-centric graph exploration. Existing visualizations have limited support for quality optimization among rectangular aspect ratios, ver…

Layout Generation