Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Ranking
Methods that learn representations of nodes in a graph play a critical role in network analysis since they enable many downstream learning tasks. We propose Graph2Gauss - an approach that can efficiently learn versatile node embeddings on large scale (attributed) graphs that show strong performance on tasks such as link prediction and node classification. Unlike most approaches that represent nodes as point vectors in a low-dimensional continuous space, we embed each node as a Gaussian distribution, allowing us to capture uncertainty about the representation. Furthermore, we propose an unsupervised method that handles inductive learning scenarios and is applicable to different types of graphs: plain/attributed, directed/undirected. By leveraging both the network structure and the associated node attributes, we are able to generalize to unseen nodes without additional training. To learn the embeddings we adopt a personalized ranking formulation w.r.t. the node distances that exploits the natural ordering of the nodes imposed by the network structure. Experiments on real world networks demonstrate the high performance of our approach, outperforming state-of-the-art network embedding methods on several different tasks. Additionally, we demonstrate the benefits of modeling uncertainty - by analyzing it we can estimate neighborhood diversity and detect the intrinsic latent dimensionality of a graph.
Code (1)
Tasks
Inductive LearningLink PredictionNetwork EmbeddingNode ClassificationSimilar Papers 제목 키워드 기반
Unsupervised Inductive Graph-Level Representation Learning via Graph-Graph Proximity
We introduce a novel approach to graph-level representation learning, which is to embed an entire graph into a vector space where the embeddings of two graphs preserve their graph-graph proximity. Our approach, UGRAPHEMB…
General ClassificationGraph ClassificationGraph EmbeddingGraph Similarity+1Gaussian Embedding of Large-scale Attributed Graphs
Graph embedding methods transform high-dimensional and complex graph contents into low-dimensional representations. They are useful for a wide range of graph analysis tasks including link prediction, node classification,…
Graph EmbeddingLink PredictionNode ClassificationInductive and Unsupervised Representation Learning on Graph Structured Objects
Inductive and unsupervised graph learning is a critical technique for predictive or information retrieval tasks where label information is difficult to obtain. It is also challenging to make graph learning inductive and …
Graph LearningGraph SimilarityInformation RetrievalRepresentation Learning+1HGATE: Heterogeneous Graph Attention Auto-Encoders
Graph auto-encoder is considered a framework for unsupervised learning on graph-structured data by representing graphs in a low dimensional space. It has been proved very powerful for graph analytics. In the real world, …
Graph AttentionGraph Representation LearningInductive LearningLink Prediction+3AttrE2vec: Unsupervised Attributed Edge Representation Learning
Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. Th…
ClusteringEdge ClassificationRepresentation Learning