Permutation-Invariant Variational Autoencoder for Graph-Level Representation Learning
Recently, there has been great success in applying deep neural networks on graph structured data. Most work, however, focuses on either node- or graph-level supervised learning, such as node, link or graph classification or node-level unsupervised learning (e.g. node clustering). Despite its wide range of possible applications, graph-level unsupervised learning has not received much attention yet. This might be mainly attributed to the high representation complexity of graphs, which can be represented by n! equivalent adjacency matrices, where n is the number of nodes. In this work we address this issue by proposing a permutation-invariant variational autoencoder for graph structured data. Our proposed model indirectly learns to match the node ordering of input and output graph, without imposing a particular node ordering or performing expensive graph matching. We demonstrate the effectiveness of our proposed model on various graph reconstruction and generation tasks and evaluate the expressive power of extracted representations for downstream graph-level classification and regression.
Code (1)
Tasks
ClusteringGeneral ClassificationGraph ClassificationGraph MatchingGraph ReconstructionNode ClusteringRepresentation LearningSimilar Papers 제목 키워드 기반
GraViti: Graph-Level Variational Autoencoders with Relaxed Permutation Invariance
We introduce GraViti, a transformer-based graph-level variational autoencoder that maps entire graphs to compact latent vectors. This design produces a true graph-level latent space that supports smooth interpolation, pr…
Multiresolution Equivariant Graph Variational Autoencoder
In this paper, we propose Multiresolution Equivariant Graph Variational Autoencoders (MGVAE), the first hierarchical generative model to learn and generate graphs in a multiresolution and equivariant manner. At each reso…
Graph GenerationImage GenerationLink Predictionmolecular representation+1SGVAE: Sequential Graph Variational Autoencoder
Generative models of graphs are well-known, but many existing models are limited in scalability and expressivity. We present a novel sequential graphical variational autoencoder operating directly on graphical representa…
Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning
The problem of permutation-invariant learning over set representations is particularly relevant in the field of multi-agent systems -- a few potential applications include unsupervised training of aggregation functions i…
Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives
Devising deep latent variable models for multi-modal data has been a long-standing theme in machine learning research. Multi-modal Variational Autoencoders (VAEs) have been a popular generative model class that learns la…
Mixture-of-Experts