Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction
Link prediction is a crucial task in graph machine learning with diverse applications. We explore the interplay between node attributes and graph topology and demonstrate that incorporating pre-trained node attributes improves the generalization power of link prediction models. Our proposed method, UPNA (Unsupervised Pre-training of Node Attributes), solves the inductive link prediction problem by learning a function that takes a pair of node attributes and predicts the probability of an edge, as opposed to Graph Neural Networks (GNN), which can be prone to topological shortcuts in graphs with power-law degree distribution. In this manner, UPNA learns a significant part of the latent graph generation mechanism since the learned function can be used to add incoming nodes to a growing graph. By leveraging pre-trained node attributes, we overcome observational bias and make meaningful predictions about unobserved nodes, surpassing state-of-the-art performance (3X to 34X improvement on benchmark datasets). UPNA can be applied to various pairwise learning tasks and integrated with existing link prediction models to enhance their generalizability and bolster graph generative models.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph GenerationInductive Link PredictionLink PredictionPredictionUnsupervised Pre-trainingSimilar Papers 제목 키워드 기반
Modeling Topological Impact on Node Attribute Distributions in Attributed Graphs
We investigate how the topology of attributed graphs influences the distribution of node attributes. This work offers a novel perspective by treating topology and attributes as structurally distinct but interacting compo…
Graph Anomaly DetectionTopology-guided Hypergraph Transformer Network: Unveiling Structural Insights for Improved Representation
Hypergraphs, with their capacity to depict high-order relationships, have emerged as a significant extension of traditional graphs. Although Graph Neural Networks (GNNs) have remarkable performance in graph representatio…
Graph Representation LearningNode ClassificationRepresentation LearningARISE: Graph Anomaly Detection on Attributed Networks via Substructure Awareness
Recently, graph anomaly detection on attributed networks has attracted growing attention in data mining and machine learning communities. Apart from attribute anomalies, graph anomaly detection also aims at suspicious to…
Anomaly DetectionAttributeContrastive LearningGraph Anomaly Detection+1Deep Multi-attributed Graph Translation with Node-Edge Co-evolution
Generalized from image and language translation, graph translation aims to generate a graph in the target domain by conditioning an input graph in the source domain. This promising topic has attracted fast-increasing att…
TranslationBSAL: A Framework of Bi-component Structure and Attribute Learning for Link Prediction
Given the ubiquitous existence of graph-structured data, learning the representations of nodes for the downstream tasks ranging from node classification, link prediction to graph classification is of crucial importance. …
AttributeGraph ClassificationLink PredictionNode Classification+1