paper-with-me

Papers

Simple Graph Condensation

2024-03-22 · Zhenbang Xiao, Yu Wang, Shunyu Liu, Huiqiong Wang, Mingli Song, Tongya Zheng

The burdensome training costs on large-scale graphs have aroused significant interest in graph condensation, which involves tuning Graph Neural Networks (GNNs) on a small condensed graph for use on the large-scale original graph. Existing methods primarily focus on aligning key metrics between the condensed and original graphs, such as gradients, output distribution and trajectories of GNNs, yielding satisfactory performance on downstream tasks. However, these complex metrics necessitate intricate external parameters and can potentially disrupt the optimization process of the condensation graph, making the condensation process highly demanding and unstable. Motivated by the recent success of simplified models across various domains, we propose a simplified approach to metric alignment in graph condensation, aiming to reduce unnecessary complexity inherited from intricate metrics. We introduce the Simple Graph Condensation (SimGC) framework, which aligns the condensed graph with the original graph from the input layer to the prediction layer, guided by a pre-trained Simple Graph Convolution (SGC) model on the original graph. Importantly, SimGC eliminates external parameters and exclusively retains the target condensed graph during the condensation process. This straightforward yet effective strategy achieves a significant speedup of up to 10 times compared to existing graph condensation methods while performing on par with state-of-the-art baselines. Comprehensive experiments conducted on seven benchmark datasets demonstrate the effectiveness of SimGC in prediction accuracy, condensation time, and generalization capability. Our code is available at https://github.com/BangHonor/SimGC.

📄 PDF Abstract BibTeX arXiv:2403.14951

Code (1)

banghonor/simgc 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Training-free Heterogeneous Graph Condensation via Data Selection

2024-12-20 · Yuxuan Liang, Wentao Zhang, Xinyi Gao, Ling Yang 외

Efficient training of large-scale heterogeneous graphs is of paramount importance in real-world applications. However, existing approaches typically explore simplified models to mitigate resource and time overhead, negle…

Graph Generation

Disentangled Condensation for Large-scale Graphs

2024-01-18 · Zhenbang Xiao, Yu Wang, Shunyu Liu, Bingde Hu 외

Graph condensation has emerged as an intriguing technique to save the expensive training costs of Graph Neural Networks (GNNs) by substituting a condensed small graph with the original graph. Despite the promising result…

Graph LearningLink PredictionNode Classification

Heterogeneous Graph Condensation via Role-Aware Clustering

2026-07-03 · Fuyan Ou, Yulin Hu, Ye Yuan arxiv

Heterogeneous Graph Neural Networks (HGNNs) have exhibited remarkable efficacy in modeling complex systems with multiple types of nodes and relations, yet their training on large-scale heterogeneous graphs remains comput…

Bilevel Optimization

GC-Bench: An Open and Unified Benchmark for Graph Condensation

2024-06-30 · Qingyun Sun, Ziying Chen, Beining Yang, Cheng Ji 외

Graph condensation (GC) has recently garnered considerable attention due to its ability to reduce large-scale graph datasets while preserving their essential properties. The core concept of GC is to create a smaller, mor…

Bi-Directional Multi-Scale Graph Dataset Condensation via Information Bottleneck

2024-12-23 · Xingcheng Fu, Yisen Gao, Beining Yang, Yuxuan Wu 외

Dataset condensation has significantly improved model training efficiency, but its application on devices with different computing power brings new requirements for different data sizes. Thus, condensing multiple scale g…

Dataset Condensation