paper-with-me

홈 › Papers

Edge-Splitting MLP: Node Classification on Homophilic and Heterophilic Graphs without Message Passing

2024-12-11 · Matthias Kohn, Marcel Hoffmann, Ansgar Scherp

Message Passing Neural Networks (MPNNs) have demonstrated remarkable success in node classification on homophilic graphs. It has been shown that they do not solely rely on homophily but on neighborhood distributions of nodes, i.e., consistency of the neighborhood label distribution within the same class. MLP-based models do not use message passing, \eg Graph-MLP incorporates the neighborhood in a separate loss function. These models are faster and more robust to edge noise. Graph-MLP maps adjacent nodes closer in the embedding space but is unaware of the neighborhood pattern of the labels, i.e., relies solely on homophily. Edge Splitting GNN (ES-GNN) is a model specialized for heterophilic graphs and splits the edges into task-relevant and task-irrelevant, respectively. To mitigate the limitations of Graph-MLP on heterophilic graphs, we propose ES-MLP that combines Graph-MLP with an edge-splitting mechanism from ES-GNN. It incorporates the edge splitting into the loss of Graph-MLP to learn two separate adjacency matrices based on relevant and irrelevant feature pairs. Our experiments on seven datasets with six baselines show that ES-MLP is on par with homophilic and heterophilic models on all datasets without using edges during inference. We show that ES-MLP is robust to multiple types of edge noise during inference and that its inference time is two to five times faster than that of commonly used MPNNs. The source code is available at https://github.com/MatthiasKohn/ES-MLP.

📄 PDF Abstract BibTeX arXiv:2412.08310

Code (1)

matthiaskohn/es-mlp 공식 구현 pytorch

Tasks

Node Classification

Similar Papers 제목 키워드 기반

Imbalanced Node Classification Beyond Homophilic Assumption

2023-04-28 · Jie Liu, Mengting He, Guangtao Wang, Nguyen Quoc Viet Hung 외

Imbalanced node classification widely exists in real-world networks where graph neural networks (GNNs) are usually highly inclined to majority classes and suffer from severe performance degradation on classifying minorit…

ClassificationNode Classification

Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?

2023-06-02 · NeurIPS 2023 11 · Haitao Mao, Zhikai Chen, Wei Jin, Haoyu Han 외

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs. Notably, m…

AllNode Classification

Exploring the Potential of Large Language Models for Heterophilic Graphs

2024-08-26 · Yuxia Wu, Shujie Li, Yuan Fang, Chuan Shi

Large language models (LLMs) have presented significant opportunities to enhance various machine learning applications, including graph neural networks (GNNs). By leveraging the vast open-world knowledge within LLMs, we …

Node ClassificationWorld Knowledge

ScaleNet: Scale Invariance Learning in Directed Graphs

2024-11-13 · Qin Jiang, Chengjia Wang, Michael Lones, Yingfang Yuan 외

Graph Neural Networks (GNNs) have advanced relational data analysis but lack invariance learning techniques common in image classification. In node classification with GNNs, it is actually the ego-graph of the center nod…

ClassificationGraph Learningimage-classificationImage Classification+1

Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approach

2024-06-05 · Haoyu Han, Juanhui Li, Wei Huang, Xianfeng Tang 외

Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for …

Mixture-of-ExpertsNode Classification