Rethinking Graph Regularization for Graph Neural Networks
The graph Laplacian regularization term is usually used in semi-supervised representation learning to provide graph structure information for a model $f(X)$. However, with the recent popularity of graph neural networks (GNNs), directly encoding graph structure $A$ into a model, i.e., $f(A, X)$, has become the more common approach. While we show that graph Laplacian regularization brings little-to-no benefit to existing GNNs, and propose a simple but non-trivial variant of graph Laplacian regularization, called Propagation-regularization (P-reg), to boost the performance of existing GNN models. We provide formal analyses to show that P-reg not only infuses extra information (that is not captured by the traditional graph Laplacian regularization) into GNNs, but also has the capacity equivalent to an infinite-depth graph convolutional network. We demonstrate that P-reg can effectively boost the performance of existing GNN models on both node-level and graph-level tasks across many different datasets.
Code (1)
Tasks
Node ClassificationRepresentation LearningSimilar Papers 제목 키워드 기반
Rethinking Regularization Methods for Knowledge Graph Completion
Knowledge graph completion (KGC) has attracted considerable attention in recent years because it is critical to improving the quality of knowledge graphs. Researchers have continuously explored various models. However, m…
Knowledge Graph CompletionKnowledge GraphsRethinking Semi-Supervised Imbalanced Node Classification from Bias-Variance Decomposition
This paper introduces a new approach to address the issue of class imbalance in graph neural networks (GNNs) for learning on graph-structured data. Our approach integrates imbalanced node classification and Bias-Variance…
Node ClassificationRethinking Symmetric Matrix Factorization: A More General and Better Clustering Perspective
Nonnegative matrix factorization (NMF) is widely used for clustering with strong interpretability. Among general NMF problems, symmetric NMF is a special one that plays an important role in graph clustering where each el…
ClusteringGraph ClusteringRethinking Message Passing Neural Networks with Diffusion Distance-guided Stress Majorization
Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoot…
Rethinking Graph Neural Networks for Anomaly Detection
Graph Neural Networks (GNNs) are widely applied for graph anomaly detection. As one of the key components for GNN design is to select a tailored spectral filter, we take the first step towards analyzing anomalies via the…
Anomaly DetectionGraph Anomaly DetectionGraph Neural Network