paper-with-me

홈 › Papers

ScaleGNN: Towards Scalable Graph Neural Networks via Adaptive High-order Neighboring Feature Fusion

2025-04-22 · Xiang Li, Jianpeng Qi, Haobing Liu, Yuan Cao, Guoqing Chao, Zhongying Zhao, Junyu Dong, Yanwei Yu

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, when applied to large-scale real-world graphs, GNNs face two major challenges: First, it becomes increasingly difficult to ensure both scalability and efficiency, as the repeated aggregation of large neighborhoods leads to significant computational overhead; Second, the over-smoothing problem arises, where excessive or deep propagation makes node representations indistinguishable, severely hindering model expressiveness. To tackle these issues, we propose ScaleGNN, a novel framework that adaptively fuses multi-hop node features for both scalable and effective graph learning. First, we construct per-hop pure neighbor matrices that capture only the exclusive structural information at each hop, avoiding the redundancy of conventional aggregation. Then, an enhanced feature fusion strategy significantly balances low-order and high-order information, preserving both local detail and global correlations without incurring excessive complexity. To further reduce redundancy and over-smoothing, we introduce a Local Contribution Score (LCS)-based masking mechanism to filter out less relevant high-order neighbors, ensuring that only the most meaningful information is aggregated. In addition, learnable sparse constraints selectively integrate multi-hop valuable features, emphasizing the most informative high-order neighbors. Extensive experiments on real-world datasets demonstrate that ScaleGNN consistently outperforms state-of-the-art GNNs in both predictive accuracy and computational efficiency, highlighting its practical value for large-scale graph learning.

📄 PDF Abstract BibTeX arXiv:2504.15920

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGraph Learning

Similar Papers 제목 키워드 기반

Communication-free Sampling and 4D Hybrid Parallelism for Scalable Mini-batch GNN Training

2026-04-03 · Cunyang Wei, Siddharth Singh, Aishwarya Sarkar, Daniel Nichols 외 arxiv

Graph neural networks (GNNs) are widely used for learning on graph datasets derived from various real-world scenarios. Learning from extremely large graphs requires distributed training, and mini-batching with sampling i…

Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks

2021-06-09 · Mario Lino, Chris Cantwell, Anil A. Bharath, Stathi Fotiadis

Continuum mechanics simulators, numerically solving one or more partial differential equations, are essential tools in many areas of science and engineering, but their performance often limits application in practice. Re…

Graph Neural NetworkInductive Bias

Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks

2022-05-05 · Mario Lino, Stathi Fotiadis, Anil A. Bharath, Chris Cantwell

Numerical simulators are essential tools in the study of natural fluid-systems, but their performance often limits application in practice. Recent machine-learning approaches have demonstrated their ability to accelerate…

Graph Neural Network

Scalable and Adaptive Spectral Embedding for Attributed Graph Clustering

2024-08-11 · Yunhui Liu, Tieke He, Qing Wu, Tao Zheng 외

Attributed graph clustering, which aims to group the nodes of an attributed graph into disjoint clusters, has made promising advancements in recent years. However, most existing methods face challenges when applied to la…

ClusteringGraph Clustering

GEM+: Scalable State-of-the-Art Private Synthetic Data with Generator Networks

2025-11-12 · Samuel Maddock, Shripad Gade, Graham Cormode, Will Bullock arxiv

State-of-the-art differentially private synthetic tabular data has been defined by adaptive 'select-measure-generate' frameworks, exemplified by methods like AIM. These approaches iteratively measure low-order noisy marg…