Graph Polynomial Convolution Models for Node Classification of Non-Homophilous Graphs
We investigate efficient learning from higher-order graph convolution and learning directly from adjacency matrices for node classification. We revisit the scaled graph residual network and remove ReLU activation from residual layers and apply a single weight matrix at each residual layer. We show that the resulting model lead to new graph convolution models as a polynomial of the normalized adjacency matrix, the residual weight matrix, and the residual scaling parameter. Additionally, we propose adaptive learning between directly graph polynomial convolution models and learning directly from the adjacency matrix. Furthermore, we propose fully adaptive models to learn scaling parameters at each residual layer. We show that generalization bounds of proposed methods are bounded as a polynomial of eigenvalue spectrum, scaling parameters, and upper bounds of residual weights. By theoretical analysis, we argue that the proposed models can obtain improved generalization bounds by limiting the higher-orders of convolutions and direct learning from the adjacency matrix. Using a wide set of real-data, we demonstrate that the proposed methods obtain improved accuracy for node-classification of non-homophilous graphs.
Code (0)
등록된 구현이 없습니다.
Tasks
Generalization BoundsNode ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Simplified Graph Convolution with Heterophily
Recent work has shown that a simple, fast method called Simple Graph Convolution (SGC) (Wu et al., 2019), which eschews deep learning, is competitive with deep methods like graph convolutional networks (GCNs) (Kipf & Wel…
Node ClassificationFlow Matters: Directional and Expressive GNNs for Heterophilic Graphs
In heterophilic graphs, where neighboring nodes often belong to different classes, conventional Graph Neural Networks (GNNs) struggle due to their reliance on local homophilous neighborhoods. Prior studies suggest that m…
Node ClassificationGraph LearningGLINKX: A Scalable Unified Framework For Homophilous and Heterophilous Graphs
In graph learning, there have been two predominant inductive biases regarding graph-inspired architectures: On the one hand, higher-order interactions and message passing work well on homophilous graphs and are leveraged…
Graph LearningKnowledge Graph EmbeddingsRevisiting Heterophily in Graph Convolution Networks by Learning Representations Across Topological and Feature Spaces
Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have sole…
Node ClassificationLarge Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods
Many widely used datasets for graph machine learning tasks have generally been homophilous, where nodes with similar labels connect to each other. Recently, new Graph Neural Networks (GNNs) have been developed that move …
Graph LearningNode ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs