MissDiff: Training Diffusion Models on Tabular Data with Missing Values

2023-07-02 · Yidong Ouyang, Liyan Xie, Chongxuan Li, Guang Cheng

The diffusion model has shown remarkable performance in modeling data distributions and synthesizing data. However, the vanilla diffusion model requires complete or fully observed data for training. Incomplete data is a common issue in various real-world applications, including healthcare and finance, particularly when dealing with tabular datasets. This work presents a unified and principled diffusion-based framework for learning from data with missing values under various missing mechanisms. We first observe that the widely adopted "impute-then-generate" pipeline may lead to a biased learning objective. Then we propose to mask the regression loss of Denoising Score Matching in the training phase. We prove the proposed method is consistent in learning the score of data distributions, and the proposed training objective serves as an upper bound for the negative likelihood in certain cases. The proposed framework is evaluated on multiple tabular datasets using realistic and efficacious metrics and is demonstrated to outperform state-of-the-art diffusion model on tabular data with "impute-then-generate" pipeline by a large margin.

📄 PDF Abstract BibTeX arXiv:2307.00467

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingMissing Values

Methods 이 논문이 사용한 방법론

Denoising Score Matching Training a denoiser on signals gives you a powerful prior over this signal that you can then use to sample examples of this signal.

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Masking

2026-06-02 · Jungkyu Kim, Taeyoung Park, Kibok Lee arxiv

Score-based diffusion models have emerged as prominent deep generative models; however, their application to tabular data remains challenging because their backbones assume fully specified inputs, whereas real-world tabu…

Diffusion models for missing value imputation in tabular data

2022-10-31 · Shuhan Zheng, Nontawat Charoenphakdee

Missing value imputation in machine learning is the task of estimating the missing values in the dataset accurately using available information. In this task, several deep generative modeling methods have been proposed a…

Imputation Missing Values Time Series Time Series Analysis

MissDDIM: Deterministic and Efficient Conditional Diffusion for Tabular Data Imputation

2025-08-05 · Youran Zhou, Mohamed Reda Bouadjenek, Sunil Aryal arxiv

Diffusion models have recently emerged as powerful tools for missing data imputation by modeling the joint distribution of observed and unobserved variables. However, existing methods, typically based on stochastic denoi…

DiffImpute: Tabular Data Imputation With Denoising Diffusion Probabilistic Model

2024-03-20 · Yizhu Wen, Kai Yi, Jing Ke, Yiqing Shen

Tabular data plays a crucial role in various domains but often suffers from missing values, thereby curtailing its potential utility. Traditional imputation techniques frequently yield suboptimal results and impose subst…

Denoising Imputation Missing Values

Self-Supervision Improves Diffusion Models for Tabular Data Imputation

2024-07-25 · Yixin Liu, Thalaiyasingam Ajanthan, Hisham Husain, Vu Nguyen

The ubiquity of missing data has sparked considerable attention and focus on tabular data imputation methods. Diffusion models, recognized as the cutting-edge technique for data generation, demonstrate significant potent…

Data Augmentation Diversity Imputation Sensitivity