paper-with-me

홈 › Papers

Navigating Complexity: Toward Lossless Graph Condensation via Expanding Window Matching

2024-02-07 · Yuchen Zhang, Tianle Zhang, Kai Wang, Ziyao Guo, Yuxuan Liang, Xavier Bresson, Wei Jin, Yang You

Graph condensation aims to reduce the size of a large-scale graph dataset by synthesizing a compact counterpart without sacrificing the performance of Graph Neural Networks (GNNs) trained on it, which has shed light on reducing the computational cost for training GNNs. Nevertheless, existing methods often fall short of accurately replicating the original graph for certain datasets, thereby failing to achieve the objective of lossless condensation. To understand this phenomenon, we investigate the potential reasons and reveal that the previous state-of-the-art trajectory matching method provides biased and restricted supervision signals from the original graph when optimizing the condensed one. This significantly limits both the scale and efficacy of the condensed graph. In this paper, we make the first attempt toward \textit{lossless graph condensation} by bridging the previously neglected supervision signals. Specifically, we employ a curriculum learning strategy to train expert trajectories with more diverse supervision signals from the original graph, and then effectively transfer the information into the condensed graph with expanding window matching. Moreover, we design a loss function to further extract knowledge from the expert trajectories. Theoretical analysis justifies the design of our method and extensive experiments verify its superiority across different datasets. Code is released at https://github.com/NUS-HPC-AI-Lab/GEOM.

📄 PDF Abstract BibTeX arXiv:2402.05011

Code (2)

nus-hpc-ai-lab/geom 공식 구현 pytorch
ztlmememe/T2VHE

Similar Papers 제목 키워드 기반

GC-Bench: An Open and Unified Benchmark for Graph Condensation

2024-06-30 · Qingyun Sun, Ziying Chen, Beining Yang, Cheng Ji 외

Graph condensation (GC) has recently garnered considerable attention due to its ability to reduce large-scale graph datasets while preserving their essential properties. The core concept of GC is to create a smaller, mor…

Simple Graph Condensation

2024-03-22 · Zhenbang Xiao, Yu Wang, Shunyu Liu, Huiqiong Wang 외

The burdensome training costs on large-scale graphs have aroused significant interest in graph condensation, which involves tuning Graph Neural Networks (GNNs) on a small condensed graph for use on the large-scale origin…

EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation

2025-06-04 · Jinghan Jia, Hadi Reisizadeh, Chongyu Fan, Nathalie Baracaldo 외

Large language models (LLMs) have shown remarkable reasoning capabilities when trained with chain-of-thought (CoT) supervision. However, the long and verbose CoT traces, especially those distilled from large reasoning mo…

Scalable Graph Condensation with Evolving Capabilities

2025-02-24 · Shengbo Gong, Mohammad Hashemi, Juntong Ni, Carl Yang 외

Graph data has become a pivotal modality due to its unique ability to model relational datasets. However, real-world graph data continues to grow exponentially, resulting in a quadratic increase in the complexity of most…

Clustering

Robust Graph Condensation via Classification Complexity Mitigation

2025-10-30 · Jiayi Luo, Qingyun Sun, Beining Yang, Haonan Yuan 외 arxiv

Graph condensation (GC) has gained significant attention for its ability to synthesize smaller yet informative graphs. However, existing studies often overlook the robustness of GC in scenarios where the original graph i…

Graph Learning