Understanding Generalization in Node and Link Prediction
Using message-passing graph neural networks (MPNNs) for node and link prediction is crucial in various scientific and industrial domains, which has led to the development of diverse MPNN architectures. Besides working well in practical settings, their ability to generalize beyond the training set remains poorly understood. While some studies have explored MPNNs' generalization in graph-level prediction tasks, much less attention has been given to node- and link-level predictions. Existing works often rely on unrealistic i.i.d.\@ assumptions, overlooking possible correlations between nodes or links, and assuming fixed aggregation and impractical loss functions while neglecting the influence of graph structure. In this work, we introduce a unified framework to analyze the generalization properties of MPNNs in inductive and transductive node and link prediction settings, incorporating diverse architectural parameters and loss functions and quantifying the influence of graph structure. Additionally, our proposed generalization framework can be applied beyond graphs to any classification task under the inductive or transductive setting. Our empirical study supports our theoretical insights, deepening our understanding of MPNNs' generalization capabilities in these tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Link PredictionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Line Graph Contrastive Learning for Link Prediction
Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the s…
Contrastive LearningLink PredictionNode ClassificationPredictionDisentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction
Link prediction is a crucial task in graph machine learning with diverse applications. We explore the interplay between node attributes and graph topology and demonstrate that incorporating pre-trained node attributes im…
Graph GenerationInductive Link PredictionLink PredictionPrediction+1Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Types
The task of fully inductive link prediction in knowledge graphs has gained significant attention, with various graph neural networks being proposed to address it. This task presents greater challenges than traditional in…
Inductive Link PredictionKnowledge Graph CompletionKnowledge GraphsLink Prediction+5A Multi-Task Perspective for Link Prediction with New Relation Types and Nodes
The task of inductive link prediction in (discrete) attributed multigraphs infers missing attributed links (relations) between nodes in new test multigraphs. Traditional relational learning methods face the challenge of …
Inductive Link PredictionLink PredictionPredictionRelation+1Explainable Automatic Hypothesis Generation via High-order Graph Walks
In this paper, we study the automatic hypothesis generation (HG) problem, focusing on explainability. Given pairs of biomedical terms, we focus on link prediction to explain how the prediction was made. This more transpa…
Link PredictionPredictionVocal Bursts Intensity Prediction