Variational Graph Recurrent Neural Networks
Representation learning over graph structured data has been mostly studied in static graph settings while efforts for modeling dynamic graphs are still scant. In this paper, we develop a novel hierarchical variational model that introduces additional latent random variables to jointly model the hidden states of a graph recurrent neural network (GRNN) to capture both topology and node attribute changes in dynamic graphs. We argue that the use of high-level latent random variables in this variational GRNN (VGRNN) can better capture potential variability observed in dynamic graphs as well as the uncertainty of node latent representation. With semi-implicit variational inference developed for this new VGRNN architecture (SI-VGRNN), we show that flexible non-Gaussian latent representations can further help dynamic graph analytic tasks. Our experiments with multiple real-world dynamic graph datasets demonstrate that SI-VGRNN and VGRNN consistently outperform the existing baseline and state-of-the-art methods by a significant margin in dynamic link prediction.
Code (2)
Tasks
AttributeDynamic Link PredictionLink PredictionRepresentation LearningVariational InferenceSimilar Papers 제목 키워드 기반
Graph Generation with Variational Recurrent Neural Network
Generating graph structures is a challenging problem due to the diverse representations and complex dependencies among nodes. In this paper, we introduce Graph Variational Recurrent Neural Network (GraphVRNN), a probabil…
AttributeGraph GenerationGraph structure learningIntentional Choreography with Semi-Supervised Recurrent VAEs
We summarize the model and results of PirouNet, a semi-supervised recurrent variational autoencoder. Given a small amount of dance sequences labeled with qualitative choreographic annotations, PirouNet conditionally gene…
Anomaly Detection on Graph Time Series
In this paper, we use variational recurrent neural network to investigate the anomaly detection problem on graph time series. The temporal correlation is modeled by the combination of recurrent neural network (RNN) and v…
Anomaly DetectionTime SeriesTime Series AnalysisVariational InferenceVariational inference of latent state sequences using Recurrent Networks
Recent advances in the estimation of deep directed graphical models and recurrent networks let us contribute to the removal of a blind spot in the area of probabilistc modelling of time series. The proposed methods i) ca…
DenoisingImputationTime SeriesTime Series Analysis+1Variational Recurrent Neural Networks for Graph Classification
We address the problem of graph classification based only on structural information. Inspired by natural language processing techniques (NLP), our model sequentially embeds information to estimate class membership probab…
ClassificationGeneral ClassificationGraph Classification