paper-with-me

Papers

Diffusion models for missing value imputation in tabular data

2022-10-31 · Shuhan Zheng, Nontawat Charoenphakdee

Missing value imputation in machine learning is the task of estimating the missing values in the dataset accurately using available information. In this task, several deep generative modeling methods have been proposed and demonstrated their usefulness, e.g., generative adversarial imputation networks. Recently, diffusion models have gained popularity because of their effectiveness in the generative modeling task in images, texts, audio, etc. To our knowledge, less attention has been paid to the investigation of the effectiveness of diffusion models for missing value imputation in tabular data. Based on recent development of diffusion models for time-series data imputation, we propose a diffusion model approach called "Conditional Score-based Diffusion Models for Tabular data" (TabCSDI). To effectively handle categorical variables and numerical variables simultaneously, we investigate three techniques: one-hot encoding, analog bits encoding, and feature tokenization. Experimental results on benchmark datasets demonstrated the effectiveness of TabCSDI compared with well-known existing methods, and also emphasized the importance of the categorical embedding techniques.

📄 PDF Abstract BibTeX arXiv:2210.17128

Code (1)

pfnet-research/CSDI_T 공식 구현 pytorch

Tasks

ImputationMissing ValuesTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

No Imputation of Missing Values In Tabular Data Classification Using Incremental Learning

2025-04-20 · Manar D. Samad, Kazi Fuad B. Akhter, Shourav B. Rabbani, Ibna Kowsar

Tabular data sets with varying missing values are prepared for machine learning using an arbitrary imputation strategy. Synthetic values generated by imputation models often concern data stakeholders about computational …

ImputationIncremental LearningMissing Values

DeepIFSAC: Deep Imputation of Missing Values Using Feature and Sample Attention within Contrastive Framework

2025-01-19 · Ibna Kowsar, Shourav B. Rabbani, Yina Hou, Manar D. Samad

Missing values of varying patterns and rates in real-world tabular data pose a significant challenge in developing reliable data-driven models. The most commonly used statistical and machine learning methods for missing …

Contrastive LearningData AugmentationImputationMissing Values

Learning What Not to Impute: An Uncertainty-Aware Diffusion Framework for Meaningful Missingness

2026-06-03 · Lixing Zhang, Yidong Ouyang, Weifu Li, Shixiang Zhu 외 arxiv

Missing value imputation is a fundamental task in machine learning, with most existing methods assuming that all missing entries correspond to unobserved regular values. In many real-world datasets, however, missingness …

DiffImpute: Tabular Data Imputation With Denoising Diffusion Probabilistic Model

2024-03-20 · Yizhu Wen, Kai Yi, Jing Ke, Yiqing Shen

Tabular data plays a crucial role in various domains but often suffers from missing values, thereby curtailing its potential utility. Traditional imputation techniques frequently yield suboptimal results and impose subst…

DenoisingImputationMissing Values

Self-Supervision Improves Diffusion Models for Tabular Data Imputation

2024-07-25 · Yixin Liu, Thalaiyasingam Ajanthan, Hisham Husain, Vu Nguyen

The ubiquity of missing data has sparked considerable attention and focus on tabular data imputation methods. Diffusion models, recognized as the cutting-edge technique for data generation, demonstrate significant potent…

Data AugmentationDiversityImputationSensitivity