Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Types
The task of fully inductive link prediction in knowledge graphs has gained significant attention, with various graph neural networks being proposed to address it. This task presents greater challenges than traditional inductive link prediction tasks with only new nodes, as models must be capable of zero-shot generalization to both unseen nodes and unseen relation types in the inference graph. Despite the development of novel models, a unifying theoretical understanding of their success remains elusive, and the limitations of these methods are not well-studied. In this work, we introduce the concept of double permutation-equivariant representations and demonstrate its necessity for effective performance in this task. We show that many existing models, despite their diverse architectural designs, conform to this framework. However, we also identify inherent limitations in double permutation-equivariant representations, which restrict these models's ability to learn effectively on datasets with varying characteristics. Our findings suggest that while double equivariance is necessary for meta-learning across knowledge graphs from different domains, it is not sufficient. There remains a fundamental gap between double permutation-equivariant models and the concept of foundation models designed to learn patterns across all domains.
Code (1)
Tasks
Inductive Link PredictionKnowledge Graph CompletionKnowledge GraphsLink PredictionLogical ReasoningMeta-LearningRelationRelational ReasoningZero-shot GeneralizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Multi-Task Perspective for Link Prediction with New Relation Types and Nodes
The task of inductive link prediction in (discrete) attributed multigraphs infers missing attributed links (relations) between nodes in new test multigraphs. Traditional relational learning methods face the challenge of …
Inductive Link PredictionLink PredictionPredictionRelation+1Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks
Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on. Many works have r…
Link PredictionPredictionSoft Geometric Inductive Bias for Object Centric Dynamics
Equivariance is a powerful prior for learning physical dynamics, yet exact group equivariance can degrade performance if the symmetries are broken. We propose object-centric world models built with geometric algebra neur…
Inductive Link Prediction for Nodes Having Only Attribute Information
Predicting the link between two nodes is a fundamental problem for graph data analytics. In attributed graphs, both the structure and attribute information can be utilized for link prediction. Most existing studies focus…
AttributeInductive Link PredictionLink PredictionPredictionLeap: Inductive Link Prediction via Learnable TopologyAugmentation
Link prediction is a crucial task in many downstream applications of graph machine learning. To this end, Graph Neural Network (GNN) is a widely used technique for link prediction, mainly in transductive settings, where …
Graph Neural NetworkInductive BiasInductive Link PredictionLink Prediction+1