paper-with-me

Papers

Diffusion Models for Graphs Benefit From Discrete State Spaces

2022-10-04 · Kilian Konstantin Haefeli, Karolis Martinkus, Nathanaël Perraudin, Roger Wattenhofer

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on continuous Gaussian perturbations. Instead, in this work, we suggest using discrete noise for the forward Markov process. This ensures that in every intermediate step the graph remains discrete. Compared to the previous approach, our experimental results on four datasets and multiple architectures show that using a discrete noising process results in higher quality generated samples indicated with an average MMDs reduced by a factor of 1.5. Furthermore, the number of denoising steps is reduced from 1000 to 32 steps, leading to a 30 times faster sampling procedure.

📄 PDF Abstract BibTeX arXiv:2210.01549

Code (1)

kilian888/discrete_dppm_graphs 공식 구현 pytorch

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SynBridge: Bridging Reaction States via Discrete Flow for Bidirectional Reaction Prediction

2025-07-11 · Haitao Lin, Junjie Wang, Zhifeng Gao, Xiaohong Ji 외 arxiv

The essence of a chemical reaction lies in the redistribution and reorganization of electrons, which is often manifested through electron transfer or the migration of electron pairs. These changes are inherently discrete…

CANDI: Hybrid Discrete-Continuous Diffusion Models

2025-10-26 · Patrick Pynadath, Jiaxin Shi, Ruqi Zhang arxiv

While continuous diffusion has shown remarkable success in continuous domains such as image generation, its direct application to discrete data has underperformed pure discrete formulations. To understand this gap, we in…

Image GenerationText Generation

Learning Discrete Diffusion of Graphs via Free-Energy Gradient Flows

2026-04-13 · Dario Rancati, Jan Maas, Francesco Locatello arxiv

Diffusion-based models on continuous spaces have seen substantial recent progress through the mathematical framework of gradient flows, leveraging the Wasserstein-2 (${W}_2$) metric via the Jordan-Kinderlehrer-Otto (JKO)…

Split Gibbs Discrete Diffusion Posterior Sampling

2025-03-03 · Wenda Chu, Yang song, Yisong Yue

We study the problem of posterior sampling in discrete-state spaces using discrete diffusion models. While posterior sampling methods for continuous diffusion models have achieved remarkable progress, analogous methods f…

Discrete Diffusion-Based Model-Level Explanation of Heterogeneous GNNs with Node Features

2025-08-11 · Pallabee Das, Stefan Heindorf arxiv

Many real-world datasets, such as citation networks, social networks, and molecular structures, are naturally represented as heterogeneous graphs, where nodes belong to different types and have additional features. For e…

Molecular Property PredictionFake News DetectionNode Classification