Do Graph Diffusion Models Accurately Capture and Generate Substructure Distributions?
Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood. Unlike models in other domains, popular backbones for graph diffusion models, such as Graph Transformers, do not possess universal expressivity to accurately model the distribution scores of complex graph data. Our work addresses this limitation by focusing on the frequency of specific substructures as a key characteristic of target graph distributions. When evaluating existing models using this metric, we find that they fail to maintain the distribution of substructure counts observed in the training set when generating new graphs. To address this issue, we establish a theoretical connection between the expressivity of Graph Neural Networks (GNNs) and the overall performance of graph diffusion models, demonstrating that more expressive GNN backbones can better capture complex distribution patterns. By integrating advanced GNNs into the backbone architecture, we achieve significant improvements in substructure generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Capturing Graphs with Hypo-Elliptic Diffusions
Convolutional layers within graph neural networks operate by aggregating information about local neighbourhood structures; one common way to encode such substructures is through random walks. The distribution of these ra…
SGOOD: Substructure-enhanced Graph-Level Out-of-Distribution Detection
Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, mode…
Out-of-Distribution DetectionRepresentation LearningGraph Energy-based Model for Substructure Preserving Molecular Design
It is common practice for chemists to search chemical databases based on substructures of compounds for finding molecules with desired properties. The purpose of de novo molecular generation is to generate instead of sea…
SubGDiff: A Subgraph Diffusion Model to Improve Molecular Representation Learning
Molecular representation learning has shown great success in advancing AI-based drug discovery. The core of many recent works is based on the fact that the 3D geometric structure of molecules provides essential informati…
DenoisingDrug Discoverymolecular representationRepresentation LearningFrom Sequence to Structure: Uncovering Substructure Reasoning in Transformers
Recent studies suggest that large language models (LLMs) possess the capability to solve graph reasoning tasks. Notably, even when graph structures are embedded within textual descriptions, LLMs can still effectively ans…