paper-with-me

홈 › Papers

Interpretable Sparsification of Brain Graphs: Better Practices and Effective Designs for Graph Neural Networks

2023-06-26 · Gaotang Li, Marlena Duda, Xiang Zhang, Danai Koutra, Yujun Yan

Brain graphs, which model the structural and functional relationships between brain regions, are crucial in neuroscientific and clinical applications involving graph classification. However, dense brain graphs pose computational challenges including high runtime and memory usage and limited interpretability. In this paper, we investigate effective designs in Graph Neural Networks (GNNs) to sparsify brain graphs by eliminating noisy edges. While prior works remove noisy edges based on explainability or task-irrelevant properties, their effectiveness in enhancing performance with sparsified graphs is not guaranteed. Moreover, existing approaches often overlook collective edge removal across multiple graphs. To address these issues, we introduce an iterative framework to analyze different sparsification models. Our findings are as follows: (i) methods prioritizing interpretability may not be suitable for graph sparsification as they can degrade GNNs' performance in graph classification tasks; (ii) simultaneously learning edge selection with GNN training is more beneficial than post-training; (iii) a shared edge selection across graphs outperforms separate selection for each graph; and (iv) task-relevant gradient information aids in edge selection. Based on these insights, we propose a new model, Interpretable Graph Sparsification (IGS), which enhances graph classification performance by up to 5.1% with 55.0% fewer edges. The retained edges identified by IGS provide neuroscientific interpretations and are supported by well-established literature.

📄 PDF Abstract BibTeX arXiv:2306.14375

Code (1)

motivationss/igs 공식 구현 pytorch

Tasks

Graph Classification

Similar Papers 제목 키워드 기반

Defining and Benchmarking a Data-Centric Design Space for Brain Graph Construction

2025-08-17 · Qinwen Ge, Roza G. Bayrak, Anwar Said, Catie Chang 외 arxiv

The construction of brain graphs from functional Magnetic Resonance Imaging (fMRI) data plays a crucial role in enabling graph machine learning for neuroimaging. However, current practices often rely on rigid pipelines t…

Towards Sparsification of Graph Neural Networks

2022-09-11 · Hongwu Peng, Deniz Gurevin, Shaoyi Huang, Tong Geng 외

As real-world graphs expand in size, larger GNN models with billions of parameters are deployed. High parameter count in such models makes training and inference on graphs expensive and challenging. To reduce the computa…

image-classificationImage ClassificationLink PredictionModel Compression+3

Heterogeneous Graph Sparsification for Efficient Representation Learning

2022-11-14 · Chandan Chunduru, Chun Jiang Zhu, Blake Gains, Jinbo Bi

Graph sparsification is a powerful tool to approximate an arbitrary graph and has been used in machine learning over homogeneous graphs. In heterogeneous graphs such as knowledge graphs, however, sparsification has not b…

Graph LearningKnowledge GraphsRepresentation Learning

Principle of Relevant Information for Graph Sparsification

2022-05-31 · Shujian Yu, Francesco Alesiani, Wenzhe Yin, Robert Jenssen 외

Graph sparsification aims to reduce the number of edges of a graph while maintaining its structural properties. In this paper, we propose the first general and effective information-theoretic formulation of graph sparsif…

Multi-Task Learning

Graph Sparsification via Mixture of Graphs

2024-05-23 · Guibin Zhang, Xiangguo Sun, Yanwei Yue, Chonghe Jiang 외

Graph Neural Networks (GNNs) have demonstrated superior performance across various graph learning tasks but face significant computational challenges when applied to large-scale graphs. One effective approach to mitigate…

Graph LearningMixture-of-Experts