Unsupervised Graph Representation Learning with Inductive Shallow Node Embedding
Network science has witnessed a surge in popularity, driven by the transformative power of node representation learning for diverse applications like social network analysis and biological modeling. While shallow embedding algorithms excel at capturing network structure, they face a critical limitation – failing to generalize to unseen nodes. This paper addresses this challenge by introducing Inductive Shallow Node Embedding – as a main contribution – pioneering a novel approach that extends shallow embeddings to the realm of inductive learning. It has a novel encoder architecture that captures the local neighborhood structure of each node, enabling effective generalization to unseen nodes. In the generalization, robustness is essential to avoid degradation of performance arising from noise in the dataset. It has been theoretically proven that the covariance of the additive noise term in the proposed model is inversely proportional to the cardinality of a node’s neighbors. Another contribution is a mathematical lower bound to quantify the robustness of node embeddings, confirming its advantage over traditional shallow embedding methods, particularly in the presence of parameter noise. The proposed method demonstrably excels in dynamic networks, consistently achieving over 90% performance on previously unseen nodes compared to nodes encountered during training on various benchmarks. The empirical evaluation concludes that our method outperforms competing methods on the vast majority of datasets in both transductive and inductive tasks.
Code (1)
Tasks
Graph Representation LearningInductive LearningNode ClassificationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AttrE2vec: Unsupervised Attributed Edge Representation Learning
Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. Th…
ClusteringEdge ClassificationRepresentation LearningUnsupervised Joint k-node Graph Representations with Compositional Energy-Based Models
Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have…
Graph Neural NetworkNode ClassificationUnsupervised Joint $k$-node Graph Representations with Compositional Energy-Based Models
Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have…
Graph Neural NetworkNode ClassificationBIGSAGE: unsupervised inductive representation learning of graph via bi-attended sampling and global-biased aggregating
Different kinds of representation learning techniques on graph have shown significant effect in downstream machine learning tasks. Recently, in order to inductively learn representations for graph structures that is unob…
Representation LearningTransfer LearningiN2V: Bringing Transductive Node Embeddings to Inductive Graphs
Shallow node embeddings like node2vec (N2V) can be used for nodes without features or to supplement existing features with structure-based information. Embedding methods like N2V are limited in their application on new n…
Node ClassificationRepresentation Learning