paper-with-me

홈 › Papers

Self-Supervision Improves Diffusion Models for Tabular Data Imputation

2024-07-25 · Yixin Liu, Thalaiyasingam Ajanthan, Hisham Husain, Vu Nguyen

The ubiquity of missing data has sparked considerable attention and focus on tabular data imputation methods. Diffusion models, recognized as the cutting-edge technique for data generation, demonstrate significant potential in tabular data imputation tasks. However, in pursuit of diversity, vanilla diffusion models often exhibit sensitivity to initialized noises, which hinders the models from generating stable and accurate imputation results. Additionally, the sparsity inherent in tabular data poses challenges for diffusion models in accurately modeling the data manifold, impacting the robustness of these models for data imputation. To tackle these challenges, this paper introduces an advanced diffusion model named Self-supervised imputation Diffusion Model (SimpDM for brevity), specifically tailored for tabular data imputation tasks. To mitigate sensitivity to noise, we introduce a self-supervised alignment mechanism that aims to regularize the model, ensuring consistent and stable imputation predictions. Furthermore, we introduce a carefully devised state-dependent data augmentation strategy within SimpDM, enhancing the robustness of the diffusion model when dealing with limited data. Extensive experiments demonstrate that SimpDM matches or outperforms state-of-the-art imputation methods across various scenarios.

📄 PDF Abstract BibTeX arXiv:2407.18013

Code (1)

yixinliu233/simpdm 공식 구현 pytorch

Tasks

Data AugmentationDiversityImputationSensitivity

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Geometry-Aware Tabular Diffusion

2026-05-23 · David Turtora Zagardo arxiv

Tabular synthesis is critical for privacy-preserving sharing and augmentation, yet diffusion models rely on implicit mechanisms to capture inter-column relationships. We introduce Geometry-Aware Tabular Diffusion (GATD),…

Understanding the limitations of self-supervised learning for tabular anomaly detection

2023-09-15 · Kimberly T. Mai, Toby Davies, Lewis D. Griffin

While self-supervised learning has improved anomaly detection in computer vision and natural language processing, it is unclear whether tabular data can benefit from it. This paper explores the limitations of self-superv…

Anomaly DetectionSelf-Supervised Learning

AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Masking

2026-06-02 · Jungkyu Kim, Taeyoung Park, Kibok Lee arxiv

Score-based diffusion models have emerged as prominent deep generative models; however, their application to tabular data remains challenging because their backbones assume fully specified inputs, whereas real-world tabu…

When, Where, and How: Adaptive Binning for Tabular Self-Supervised Learning

2026-06-18 · Daehwan Kim, Haejun Chung, Ikbeom Jang arxiv

Medical tabular data are ubiquitous in clinical research, but deep learning for tables remains underexplored because reliable labels often require costly expert adjudication, even though structured clinical variables are…

Self-Supervised Learning

Quantifying and Mitigating Privacy Risks for Tabular Generative Models

2024-03-12 · Chaoyi Zhu, Jiayi Tang, Hans Brouwer, Juan F. Pérez 외

Synthetic data from generative models emerges as the privacy-preserving data-sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. The backbone t…

Privacy Preserving