paper-with-me

Papers

GSR-GNN: Training Acceleration and Memory-Saving Framework of Deep GNNs on Circuit Graph

2026-03-28 · Yuebo Luo, Shiyang Li, Yifei Feng, Vishal Kancharla, Shaoyi Huang, Caiwen Ding arxiv

Graph Neural Networks (GNNs) show strong promise for circuit analysis, but scaling to modern large-scale circuit graphs is limited by GPU memory and training cost, especially for deep models. We revisit deep GNNs for circuit graphs and show that, when trainable, they significantly outperform shallow architectures, motivating an efficient, domain-specific training framework. We propose Grouped-Sparse-Reversible GNN (GSR-GNN), which enables training GNNs with up to hundreds of layers while reducing both compute and memory overhead. GSR-GNN integrates reversible residual modules with a group-wise sparse nonlinear operator that compresses node embeddings without sacrificing task-relevant information, and employs an optimized execution pipeline to eliminate fragmented activation storage and reduce data movement. On sampled circuit graphs, GSR-GNN achieves up to 87.2\% peak memory reduction and over 30$\times$ training speedup with negligible degradation in correlation-based quality metrics, making deep GNNs practical for large-scale EDA workloads.

📄 PDF Abstract BibTeX arXiv:2603.27156

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sequential Aggregation and Rematerialization: Distributed Full-batch Training of Graph Neural Networks on Large Graphs

2021-11-11 · Hesham Mostafa

We present the Sequential Aggregation and Rematerialization (SAR) scheme for distributed full-batch training of Graph Neural Networks (GNNs) on large graphs. Large-scale training of GNNs has recently been dominated by sa…

EXACT: Scalable Graph Neural Networks Training via Extreme Activation Compression

2021-09-29 · ICLR 2022 4 · Zirui Liu, Kaixiong Zhou, Fan Yang, Li Li 외

Training Graph Neural Networks (GNNs) on large graphs is a fundamental challenge due to the high memory usage, which is mainly occupied by activations (e.g., node embeddings). Previous works usually focus on reducing the…

GPUGraph Learning

Acceleration Algorithms in GNNs: A Survey

2024-05-07 · Lu Ma, Zeang Sheng, Xunkai Li, Xinyi Gao 외

Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph-based tasks. However, their inefficiency in training and inference presents challenges for scaling up to real-world and large-scale graph appl…

Graph LearningSurvey

Expansive Supervision for Neural Radiance Field

2024-09-12 · Weixiang Zhang, Shuzhao Xie, Shijia Ge, Wei Yao 외

Neural Radiance Field (NeRF) has achieved remarkable success in creating immersive media representations through its exceptional reconstruction capabilities. However, the computational demands of dense forward passes and…

NeRF

Accelerating Generic Graph Neural Networks via Architecture, Compiler, Partition Method Co-Design

2023-08-16 · Shuwen Lu, Zhihui Zhang, Cong Guo, Jingwen Leng 외

Graph neural networks (GNNs) have shown significant accuracy improvements in a variety of graph learning domains, sparking considerable research interest. To translate these accuracy improvements into practical applicati…

GPUGraph Learninggraph partitioning