paper-with-me

홈 › Papers

Revisiting Heterophily For Graph Neural Networks

2022-10-14 · Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Mingde Zhao, Shuyuan Zhang, Xiao-Wen Chang, Doina Precup

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using graph structures based on the relational inductive bias (homophily assumption). While GNNs have been commonly believed to outperform NNs in real-world tasks, recent work has identified a non-trivial set of datasets where their performance compared to NNs is not satisfactory. Heterophily has been considered the main cause of this empirical observation and numerous works have been put forward to address it. In this paper, we first revisit the widely used homophily metrics and point out that their consideration of only graph-label consistency is a shortcoming. Then, we study heterophily from the perspective of post-aggregation node similarity and define new homophily metrics, which are potentially advantageous compared to existing ones. Based on this investigation, we prove that some harmful cases of heterophily can be effectively addressed by local diversification operation. Then, we propose the Adaptive Channel Mixing (ACM), a framework to adaptively exploit aggregation, diversification and identity channels node-wisely to extract richer localized information for diverse node heterophily situations. ACM is more powerful than the commonly used uni-channel framework for node classification tasks on heterophilic graphs and is easy to be implemented in baseline GNN layers. When evaluated on 10 benchmark node classification tasks, ACM-augmented baselines consistently achieve significant performance gain, exceeding state-of-the-art GNNs on most tasks without incurring significant computational burden.

📄 PDF Abstract BibTeX arXiv:2210.07606

Code (1)

SitaoLuan/ACM-GNN 공식 구현 pytorch

Tasks

Inductive BiasNode ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs

Similar Papers 제목 키워드 기반

Revisiting Heterophily in Graph Convolution Networks by Learning Representations Across Topological and Feature Spaces

2022-11-01 · Ashish Tiwari, Sresth Tosniwal, Shanmuganathan Raman

Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have sole…

Node Classification

Revisiting Graph-Based Fraud Detection in Sight of Heterophily and Spectrum

2023-12-11 · Fan Xu, Nan Wang, Hao Wu, Xuezhi Wen 외

Graph-based fraud detection (GFD) can be regarded as a challenging semi-supervised node binary classification task. In recent years, Graph Neural Networks (GNN) have been widely applied to GFD, characterizing the anomalo…

Binary ClassificationFraud Detection

Revisiting the role of heterophily in graph representation learning: An edge classification perspective

2022-05-23 · Jincheng Huang, Ping Li, Rui Huang, Chen Na 외

Graph representation learning aim at integrating node contents with graph structure to learn nodes/graph representations. Nevertheless, it is found that many existing graph learning methods do not work well on data with …

Edge ClassificationGraph LearningGraph Representation LearningRepresentation Learning

Hetero$^2$Net: Heterophily-aware Representation Learning on Heterogenerous Graphs

2023-10-18 · Jintang Li, Zheng Wei, Jiawang Dan, Jing Zhou 외

Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of comm…

Node ClassificationRepresentation Learning

Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approach

2022-09-17 · Wendong Bi, Lun Du, Qiang Fu, Yanlin Wang 외

Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some rese…

Node Classification