paper-with-me

홈 › Papers

Advancing Graph Generation through Beta Diffusion

2024-06-13 · Xinyang Liu, Yilin He, Bo Chen, Mingyuan Zhou

Diffusion models have excelled in generating natural images and are now being adapted to a variety of data types, including graphs. However, conventional models often rely on Gaussian or categorical diffusion processes, which can struggle to accommodate the mixed discrete and continuous components characteristic of graph data. Graphs typically feature discrete structures and continuous node attributes that often exhibit rich statistical patterns, including sparsity, bounded ranges, skewed distributions, and long-tailed behavior. To address these challenges, we introduce Graph Beta Diffusion (GBD), a generative model specifically designed to handle the diverse nature of graph data. GBD leverages a beta diffusion process, effectively modeling both continuous and discrete elements. Additionally, we propose a modulation technique that enhances the realism of generated graphs by stabilizing critical graph topology while maintaining flexibility for other components. GBD competes strongly with existing models across multiple general and biochemical graph benchmarks, showcasing its ability to capture the intricate balance between discrete and continuous features inherent in real-world graph data. The PyTorch code is available on GitHub.

📄 PDF Abstract BibTeX arXiv:2406.09357

Code (1)

xinyangATK/GraphBetaDiffusion 공식 구현 pytorch

Tasks

Graph Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Recovering Barabási-Albert Parameters of Graphs through Disentanglement

2021-05-03 · ICLR Workshop GTRL 2021 5 · Cristina Guzman, Daphna Keidar, Tristan Meynier, Andreas Opedal 외

Classical graph modeling approaches such as Erd\H{o}s R\'{e}nyi (ER) random graphs or Barab\'asi-Albert (BA) graphs, here referred to as stylized models, aim to reproduce properties of real-world graphs in an interpretab…

DecoderDisentanglementGraph GenerationGraph Neural Network

MolHIT: Advancing Molecular-Graph Generation with Hierarchical Discrete Diffusion Models

2026-02-19 · Hojung Jung, Rodrigo Hormazabal, Jaehyeong Jo, Youngrok Park 외 arxiv

Molecular generation with diffusion models has emerged as a promising direction for AI-driven drug discovery and materials science. While graph diffusion models have been widely adopted due to the discrete nature of 2D m…

Graph GenerationDrug Discovery

CMHG: A Dataset and Benchmark for Headline Generation of Minority Languages in China

2025-09-12 · Guixian Xu, Zeli Su, Ziyin Zhang, Jianing Liu 외 arxiv

Minority languages in China, such as Tibetan, Uyghur, and Traditional Mongolian, face significant challenges due to their unique writing systems, which differ from international standards. This discrepancy has led to a s…

Headline Generation

Beta Diffusion

2023-09-14 · NeurIPS 2023 11 · Mingyuan Zhou, Tianqi Chen, Zhendong Wang, Huangjie Zheng

We introduce beta diffusion, a novel generative modeling method that integrates demasking and denoising to generate data within bounded ranges. Using scaled and shifted beta distributions, beta diffusion utilizes multipl…

Denoising

Classifier-free Guidance with Adaptive Scaling

2025-02-14 · Dawid Malarz, Artur Kasymov, Maciej Zięba, Jacek Tabor 외

Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated imag…

Denoising