NESS: Node Embeddings from Static SubGraphs
We present a framework for learning Node Embeddings from Static Subgraphs (NESS) using a graph autoencoder (GAE) in a transductive setting. NESS is based on two key ideas: i) Partitioning the training graph to multiple static, sparse subgraphs with non-overlapping edges using random edge split during data pre-processing, ii) Aggregating the node representations learned from each subgraph to obtain a joint representation of the graph at test time. Moreover, we propose an optional contrastive learning approach in transductive setting. We demonstrate that NESS gives a better node representation for link prediction tasks compared to current autoencoding methods that use either the whole graph or stochastic subgraphs. Our experiments also show that NESS improves the performance of a wide range of graph encoders and achieves state-of-the-art results for link prediction on multiple real-world datasets with edge homophily ratio ranging from strong heterophily to strong homophily.
Code (1)
Tasks
Contrastive LearningGraph EmbeddingLink PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Distributed Representation of Subgraphs
Network embeddings have become very popular in learning effective feature representations of networks. Motivated by the recent successes of embeddings in natural language processing, researchers have tried to find networ…
Community DetectionNode ClassificationLearn to Cluster Faces with Better Subgraphs
Face clustering can provide pseudo-labels to the massive unlabeled face data and improve the performance of different face recognition models. The existing clustering methods generally aggregate the features within subgr…
ClusteringFace ClusteringFace RecognitionAdaGCL: Adaptive Subgraph Contrastive Learning to Generalize Large-scale Graph Training
Training graph neural networks (GNNs) with good generalizability on large-scale graphs is a challenging problem. Existing methods mainly divide the input graph into multiple subgraphs and train them in different batches …
Contrastive LearningData AugmentationNode ClassificationSelf-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks
Representation learning methods for heterogeneous networks produce a low-dimensional vector embedding for each node that is typically fixed for all tasks involving the node. Many of the existing methods focus on obtainin…
Link PredictionRepresentation LearningSelf-Supervised LearningSubgraph Frequency Distribution Estimation using Graph Neural Networks
Small subgraphs (graphlets) are important features to describe fundamental units of a large network. The calculation of the subgraph frequency distributions has a wide application in multiple domains including biology an…