paper-with-me

홈 › Papers

Mixture of Experts for Node Classification

2024-11-30 · Yu Shi, Yiqi Wang, WeiXuan Lang, Jiaxin Zhang, Pan Dong, Aiping Li

Nodes in the real-world graphs exhibit diverse patterns in numerous aspects, such as degree and homophily. However, most existent node predictors fail to capture a wide range of node patterns or to make predictions based on distinct node patterns, resulting in unsatisfactory classification performance. In this paper, we reveal that different node predictors are good at handling nodes with specific patterns and only apply one node predictor uniformly could lead to suboptimal result. To mitigate this gap, we propose a mixture of experts framework, MoE-NP, for node classification. Specifically, MoE-NP combines a mixture of node predictors and strategically selects models based on node patterns. Experimental results from a range of real-world datasets demonstrate significant performance improvements from MoE-NP.

📄 PDF Abstract BibTeX arXiv:2412.00418

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationMixture-of-ExpertsNode Classification

Similar Papers 제목 키워드 기반

Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approach

2024-06-05 · Haoyu Han, Juanhui Li, Wei Huang, Xianfeng Tang 외

Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for …

Mixture-of-ExpertsNode Classification

Mixture of Decoupled Message Passing Experts with Entropy Constraint for General Node Classification

2025-02-12 · Xuanze Chen, Jiajun Zhou, Jinsong Chen, Shanqing Yu 외

The varying degrees of homophily and heterophily in real-world graphs persistently constrain the universality of graph neural networks (GNNs) for node classification. Adopting a data-centric perspective, this work reveal…

Mixture-of-ExpertsNode ClassificationRepresentation Learning

Mixture of Experts Meets Decoupled Message Passing: Towards General and Adaptive Node Classification

2024-12-11 · Xuanze Chen, Jiajun Zhou, Shanqing Yu, Qi Xuan

Graph neural networks excel at graph representation learning but struggle with heterophilous data and long-range dependencies. And graph transformers address these issues through self-attention, yet face scalability and …

Computational EfficiencyGraph Representation LearningMixture-of-Experts+3

Mixture of Weak & Strong Experts on Graphs

2023-11-09 · Hanqing Zeng, Hanjia Lyu, Diyi Hu, Yinglong Xia 외

Realistic graphs contain both (1) rich self-features of nodes and (2) informative structures of neighborhoods, jointly handled by a Graph Neural Network (GNN) in the typical setup. We propose to decouple the two modaliti…

Graph Neural NetworkNode Classification

Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specialization

2025-10-24 · Yunlong Chu, Minglai Shao, Zengyi Wo, Bing Hao 외 arxiv

Graph Neural Networks (GNNs) face a fundamental adaptability challenge: their fixed message-passing architectures struggle with the immense diversity of real-world graphs, where optimal computational strategies vary by l…

Node ClassificationFew-Shot Learning