paper-with-me

홈 › Papers

GNNBuilder: An Automated Framework for Generic Graph Neural Network Accelerator Generation, Simulation, and Optimization

2023-03-29 · Stefan Abi-Karam, Cong Hao

There are plenty of graph neural network (GNN) accelerators being proposed. However, they highly rely on users' hardware expertise and are usually optimized for one specific GNN model, making them challenging for practical use. Therefore, in this work, we propose GNNBuilder, the first automated, generic, end-to-end GNN accelerator generation framework. It features four advantages: (1) GNNBuilder can automatically generate GNN accelerators for a wide range of GNN models arbitrarily defined by users; (2) GNNBuilder takes standard PyTorch programming interface, introducing zero overhead for algorithm developers; (3) GNNBuilder supports end-to-end code generation, simulation, accelerator optimization, and hardware deployment, realizing a push-button fashion for GNN accelerator design; (4) GNNBuilder is equipped with accurate performance models of its generated accelerator, enabling fast and flexible design space exploration (DSE). In the experiments, first, we show that our accelerator performance model has errors within $36\%$ for latency prediction and $18\%$ for BRAM count prediction. Second, we show that our generated accelerators can outperform CPU by $6.33\times$ and GPU by $6.87\times$. This framework is open-source, and the code is available at https://github.com/sharc-lab/gnn-builder.

📄 PDF Abstract BibTeX arXiv:2303.16459

Code (1)

sharc-lab/gnn-builder 공식 구현 pytorch

Tasks

Code GenerationCPUGPUGraph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

DGNN-Booster: A Generic FPGA Accelerator Framework For Dynamic Graph Neural Network Inference

2023-04-13 · Hanqiu Chen, Cong Hao

Dynamic Graph Neural Networks (DGNNs) are becoming increasingly popular due to their effectiveness in analyzing and predicting the evolution of complex interconnected graph-based systems. However, hardware deployment of …

CPUGPUGraph Neural NetworkHigh-Level Synthesis

G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency

2021-09-18 · Yongan Zhang, Haoran You, Yonggan Fu, Tong Geng 외

Graph Neural Networks (GNNs) have emerged as the state-of-the-art (SOTA) method for graph-based learning tasks. However, it still remains prohibitively challenging to inference GNNs over large graph datasets, limiting th…

TVM: An Automated End-to-End Optimizing Compiler for Deep Learning

2018-02-12 · Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng 외

There is an increasing need to bring machine learning to a wide diversity of hardware devices. Current frameworks rely on vendor-specific operator libraries and optimize for a narrow range of server-class GPUs. Deploying…

CPUDeep LearningDiversityGPU

Accelerating Generic Graph Neural Networks via Architecture, Compiler, Partition Method Co-Design

2023-08-16 · Shuwen Lu, Zhihui Zhang, Cong Guo, Jingwen Leng 외

Graph neural networks (GNNs) have shown significant accuracy improvements in a variety of graph learning domains, sparking considerable research interest. To translate these accuracy improvements into practical applicati…

GPUGraph Learninggraph partitioning

GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models

2023-09-19 · Yonggan Fu, Yongan Zhang, Zhongzhi Yu, Sixu Li 외

The remarkable capabilities and intricate nature of Artificial Intelligence (AI) have dramatically escalated the imperative for specialized AI accelerators. Nonetheless, designing these accelerators for various AI worklo…

In-Context Learning