paper-with-me

Papers

Scalable Generative Models for Graphs with Graph Attention Mechanism

2019-06-05 · ICLR 2020 1 · Wataru Kawai, Yusuke Mukuta, Tatsuya Harada

Graphs are ubiquitous real-world data structures, and generative models that approximate distributions over graphs and derive new samples from them have significant importance. Among the known challenges in graph generation tasks, scalability handling of large graphs and datasets is one of the most important for practical applications. Recently, an increasing number of graph generative models have been proposed and have demonstrated impressive results. However, scalability is still an unresolved problem due to the complex generation process or difficulty in training parallelization. In this paper, we first define scalability from three different perspectives: number of nodes, data, and node/edge labels. Then, we propose GRAM, a generative model for graphs that is scalable in all three contexts, especially in training. We aim to achieve scalability by employing a novel graph attention mechanism, formulating the likelihood of graphs in a simple and general manner. Also, we apply two techniques to reduce computational complexity. Furthermore, we construct a unified and non-domain-specific evaluation metric in node/edge-labeled graph generation tasks by combining a graph kernel and Maximum Mean Discrepancy. Our experiments on synthetic and real-world graphs demonstrated the scalability of our models and their superior performance compared with baseline methods.

📄 PDF Abstract BibTeX arXiv:1906.01861

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionGraph Generation

Similar Papers 제목 키워드 기반

From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers

2021-07-16 · Krzysztof Choromanski, Han Lin, Haoxian Chen, Tianyi Zhang 외

In this paper we provide, to the best of our knowledge, the first comprehensive approach for incorporating various masking mechanisms into Transformers architectures in a scalable way. We show that recent results on line…

Graph Attention

A Deep Probabilistic Framework for Continuous Time Dynamic Graph Generation

2024-12-20 · Ryien Hosseini, Filippo Simini, Venkatram Vishwanath, Henry Hoffmann

Recent advancements in graph representation learning have shifted attention towards dynamic graphs, which exhibit evolving topologies and features over time. The increased use of such graphs creates a paramount need for …

Anomaly DetectionData AugmentationGraph GenerationGraph Representation Learning+2

Scalable Generative Modeling of Weighted Graphs

2025-07-30 · Richard Williams, Eric Nalisnick, Andrew Holbrook arxiv

Weighted graphs are ubiquitous throughout biology, chemistry, and the social sciences, motivating the development of generative models for abstract weighted graph data using deep neural networks. However, most current de…

A Scalable and Effective Alternative to Graph Transformers

2024-06-17 · Kaan Sancak, Zhigang Hua, Jin Fang, Yan Xie 외

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph…

Graph LearningGraph Representation LearningRepresentation Learning

Bi-Level Attention Graph Neural Networks

2023-04-23 · Roshni G. Iyer, Wei Wang, Yizhou Sun

Recent graph neural networks (GNNs) with the attention mechanism have historically been limited to small-scale homogeneous graphs (HoGs). However, GNNs handling heterogeneous graphs (HeGs), which contain several entity a…

Graph AttentionRelation