paper-with-me

홈 › Papers

Tackling Oversmoothing in GNN via Graph Sparsification: A Truss-based Approach

2024-07-16 · Tanvir Hossain, Khaled Mohammed Saifuddin, Muhammad Ifte Khairul Islam, Farhan Tanvir, Esra Akbas

Graph Neural Network (GNN) achieves great success for node-level and graph-level tasks via encoding meaningful topological structures of networks in various domains, ranging from social to biological networks. However, repeated aggregation operations lead to excessive mixing of node representations, particularly in dense regions with multiple GNN layers, resulting in nearly indistinguishable embeddings. This phenomenon leads to the oversmoothing problem that hampers downstream graph analytics tasks. To overcome this issue, we propose a novel and flexible truss-based graph sparsification model that prunes edges from dense regions of the graph. Pruning redundant edges in dense regions helps to prevent the aggregation of excessive neighborhood information during hierarchical message passing and pooling in GNN models. We then utilize our sparsification model in the state-of-the-art baseline GNNs and pooling models, such as GIN, SAGPool, GMT, DiffPool, MinCutPool, HGP-SL, DMonPool, and AdamGNN. Extensive experiments on different real-world datasets show that our model significantly improves the performance of the baseline GNN models in the graph classification task.

📄 PDF Abstract BibTeX arXiv:2407.11928

Code (0)

등록된 구현이 없습니다.

Tasks

Graph ClassificationGraph Neural Network

Methods 이 논문이 사용한 방법론

GIN Per the authors, Graph Isomorphism Network (GIN) generalizes the WL test and hence achieves maximum discriminative power among GNNs.
MinCutPool MinCutPool is a trainable pooling operator for graphs that learns to map nodes into clusters. The method is trained to approximate the minimum K-cut of the graph to ensure that…
DiffPool DiffPool is a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in…
Pruning 설명 없음

Similar Papers 제목 키워드 기반

ATNPA: A Unified View of Oversmoothing Alleviation in Graph Neural Networks

2024-05-02 · Yufei Jin, Xingquan Zhu

Oversmoothing is a commonly observed challenge in graph neural network (GNN) learning, where, as layers increase, embedding features learned from GNNs quickly become similar/indistinguishable, making them incapable of di…

Graph Neural NetworkRelation

PairNorm: Tackling Oversmoothing in GNNs

2019-09-26 · ICLR 2020 1 · Lingxiao Zhao, Leman Akoglu

The performance of graph neural nets (GNNs) is known to gradually decrease with increasing number of layers. This decay is partly attributed to oversmoothing, where repeated graph convolutions eventually make node embedd…

An Effective Index for Truss-based Community Search on Large Directed Graphs

2024-01-19 · Wei Ai, CanHao Xie, Tao Meng, Yinghao Wu 외

Community search is a derivative of community detection that enables online and personalized discovery of communities and has found extensive applications in massive real-world networks. Recently, there needs to be more …

Community DetectionCommunity SearchRelationRetrieval

Fast Algorithm for K-Truss Discovery on Public-Private Graphs

2019-06-01 · Soroush Ebadian, Xin Huang

In public-private graphs, users share one public graph and have their own private graphs. A private graph consists of personal private contacts that only can be visible to its owner, e.g., hidden friend lists on Facebook…

Efficient Algorithms to Mine Maximal Span-Trusses From Temporal Graphs

2020-09-03 · Quintino Francesco Lotito, Alberto Montresor

Over the last decade, there has been an increasing interest in temporal graphs, pushed by a growing availability of temporally-annotated network data coming from social, biological and financial networks. Despite the imp…