Unifying Generation and Prediction on Graphs with Latent Graph Diffusion
In this paper, we propose the first framework that enables solving graph learning tasks of all levels (node, edge and graph) and all types (generation, regression and classification) using one formulation. We first formulate prediction tasks including regression and classification into a generic (conditional) generation framework, which enables diffusion models to perform deterministic tasks with provable guarantees. We then propose Latent Graph Diffusion (LGD), a generative model that can generate node, edge, and graph-level features of all categories simultaneously. We achieve this goal by embedding the graph structures and features into a latent space leveraging a powerful encoder and decoder, then training a diffusion model in the latent space. LGD is also capable of conditional generation through a specifically designed cross-attention mechanism. Leveraging LGD and the ``all tasks as generation'' formulation, our framework is capable of solving graph tasks of various levels and types. We verify the effectiveness of our framework with extensive experiments, where our models achieve state-of-the-art or highly competitive results across a wide range of generation and regression tasks.
Code (1)
Tasks
AllDecoderGraph LearningregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Node Attribute Generation on Graphs
Graph structured data provide two-fold information: graph structures and node attributes. Numerous graph-based algorithms rely on both information to achieve success in supervised tasks, such as node classification and l…
AttributeData AugmentationGeneral ClassificationLink Prediction+1Tensor Variable Elimination for Plated Factor Graphs
A wide class of machine learning algorithms can be reduced to variable elimination on factor graphs. While factor graphs provide a unifying notation for these algorithms, they do not provide a compact way to express repe…
Music ModelingProbabilistic ProgrammingSentiment Analysistensor algebraNode Classification Meets Link Prediction on Knowledge Graphs
Node classification and link prediction are widely studied in graph representation learning. While both transductive node classification and link prediction operate over a single input graph, they have so far been studie…
BenchmarkingClassificationGraph Representation LearningKnowledge Graphs+4A Probabilistic Graph Coupling View of Dimension Reduction
Most popular dimension reduction (DR) methods like t-SNE and UMAP are based on minimizing a cost between input and latent pairwise similarities. Though widely used, these approaches lack clear probabilistic foundations t…
Dimensionality ReductionGraphGAN: Generating Graphs via Random Walks
We propose GraphGAN - the first implicit generative model for graphs that enables to mimic real-world networks. We pose the problem of graph generation as learning the distribution of biased random walks over a single in…
Graph GenerationLink PredictionNode Classification