Inductive Representation Learning on Large Graphs
Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions. However, most existing approaches require that all nodes in the graph are present during training of the embeddings; these previous approaches are inherently transductive and do not naturally generalize to unseen nodes. Here we present GraphSAGE, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen data. Instead of training individual embeddings for each node, we learn a function that generates embeddings by sampling and aggregating features from a node's local neighborhood. Our algorithm outperforms strong baselines on three inductive node-classification benchmarks: we classify the category of unseen nodes in evolving information graphs based on citation and Reddit post data, and we show that our algorithm generalizes to completely unseen graphs using a multi-graph dataset of protein-protein interactions.
Code (20)
Tasks
Graph ClassificationGraph RegressionLink PredictionLink Property PredictionNode ClassificationNode Classification on Non-Homophilic (Heterophilic) GraphsNode Property PredictionRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Open Challenge for Inductive Link Prediction on Knowledge Graphs
An emerging trend in representation learning over knowledge graphs (KGs) moves beyond transductive link prediction tasks over a fixed set of known entities in favor of inductive tasks that imply training on one graph and…
Graph Representation LearningInductive Link PredictionKnowledge GraphsLink Prediction+1Inductive Logical Query Answering in Knowledge Graphs
Formulating and answering logical queries is a standard communication interface for knowledge graphs (KGs). Alleviating the notorious incompleteness of real-world KGs, neural methods achieved impressive results in link p…
Complex Query AnsweringEntity EmbeddingsKnowledge GraphsLink Prediction+1View Space: Learning Representation across Arbitrary Graphs
Generalizing pretrained models to unseen datasets without retraining is a central challenge toward foundation models. Achieving fully inductive inference on numerical data is particularly difficult due to large variation…
Representation LearningNode ClassificationBIGSAGE: unsupervised inductive representation learning of graph via bi-attended sampling and global-biased aggregating
Different kinds of representation learning techniques on graph have shown significant effect in downstream machine learning tasks. Recently, in order to inductively learn representations for graph structures that is unob…
Representation LearningTransfer LearningUniting Heterogeneity, Inductiveness, and Efficiency for Graph Representation Learning
With the ubiquitous graph-structured data in various applications, models that can learn compact but expressive vector representations of nodes have become highly desirable. Recently, bearing the message passing paradigm…
Graph Representation LearningRepresentation LearningTransductive Learning