paper-with-me

Papers

Discrete Diffusion with Sample-Efficient Estimators for Conditionals

2026-02-23 · Karthik Elamvazhuthi, Abhijith Jayakumar, Andrey Y. Lokhov arxiv

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than approximating a discrete analog of a score function, our formulation treats single-site conditional probabilities as the fundamental objects that parameterize the reverse diffusion process. We employ a sample-efficient method known as Neural Interaction Screening Estimator (NeurISE) to estimate these conditionals in the diffusion dynamics. Controlled experiments on synthetic Ising models, MNIST, and scientific data sets produced by a D-Wave quantum annealer, synthetic Potts model and one-dimensional quantum systems demonstrate the proposed approach. On the binary data sets, these experiments demonstrate that the proposed approach outperforms popular existing methods including ratio-based approaches, achieving improved performance in total variation, cross-correlations, and kernel density estimation metrics.

📄 PDF Abstract BibTeX arXiv:2602.20293

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Similar Papers 제목 키워드 기반

Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysis

2024-10-03 · Zikun Zhang, Zixiang Chen, Quanquan Gu

Diffusion models have achieved great success in generating high-dimensional samples across various applications. While the theoretical guarantees for continuous-state diffusion models have been extensively studied, the c…

Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps

2024-11-11 · Ricardo Baptista, Aram-Alexandre Pooladian, Michael Brennan, Youssef Marzouk 외

Conditional simulation is a fundamental task in statistical modeling: Generate samples from the conditionals given finitely many data points from a joint distribution. One promising approach is to construct conditional B…

Bayesian Inference

Information-Theoretic Discrete Diffusion

2025-10-28 · Moongyu Jeon, Sangwoo Shin, Dongjae Jeon, Albert No arxiv

We present an information-theoretic framework for discrete diffusion models that yields principled estimators of log-likelihood using score-matching losses. Inspired by the I-MMSE identity for the Gaussian setup, we deri…

Learning of Discrete Graphical Models with Neural Networks

2020-06-21 · NeurIPS 2020 12 · Abhijith J., Andrey Y. Lokhov, Sidhant Misra, Marc Vuffray

Graphical models are widely used in science to represent joint probability distributions with an underlying conditional dependence structure. The inverse problem of learning a discrete graphical model given i.i.d samples…

Estimating Mutual Information for Discrete-Continuous Mixtures

2017-09-19 · NeurIPS 2017 12 · Weihao Gao, Sreeram Kannan, Sewoong Oh, Pramod Viswanath

Estimating mutual information from observed samples is a basic primitive, useful in several machine learning tasks including correlation mining, information bottleneck clustering, learning a Chow-Liu tree, and conditiona…

ClusteringMutual Information Estimation