paper-with-me

홈 › Papers

Continuous Diffusion for Mixed-Type Tabular Data

2023-12-16 · Markus Mueller, Kathrin Gruber, Dennis Fok

Score-based generative models, commonly referred to as diffusion models, have proven to be successful at generating text and image data. However, their adaptation to mixed-type tabular data remains underexplored. In this work, we propose CDTD, a Continuous Diffusion model for mixed-type Tabular Data. CDTD is based on a novel combination of score matching and score interpolation to enforce a unified continuous noise distribution for both continuous and categorical features. We explicitly acknowledge the necessity of homogenizing distinct data types by relying on model-specific loss calibration and initialization schemes.To further address the high heterogeneity in mixed-type tabular data, we introduce adaptive feature- or type-specific noise schedules. These ensure balanced generative performance across features and optimize the allocation of model capacity across features and diffusion time. Our experimental results show that CDTD consistently outperforms state-of-the-art benchmark models, captures feature correlations exceptionally well, and that heterogeneity in the noise schedule design boosts sample quality. Replication code is available at https://github.com/muellermarkus/cdtd.

📄 PDF Abstract BibTeX arXiv:2312.10431

Code (1)

muellermarkus/cdtd 공식 구현 jax

Tasks

Tabular Data Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

XGenBoost: Synthesizing Small and Large Tabular Datasets with XGBoost

2026-03-06 · Jim Achterberg, Marcel Haas, Bram van Dijk, Marco Spruit arxiv

Tree ensembles such as XGBoost are often preferred for discriminative tasks in mixed-type tabular data, due to their inductive biases, minimal hyperparameter tuning, and training efficiency. We argue that these qualities…

Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features

2026-01-30 · Markus Mueller, Kathrin Gruber, Dennis Fok arxiv

Advances in generative modeling have recently been adapted to tabular data containing discrete and continuous features. However, generating mixed-type features that combine discrete states with an otherwise continuous di…

CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesis

2023-04-25 · Chaejeong Lee, Jayoung Kim, Noseong Park

With growing attention to tabular data these days, the attempt to apply a synthetic table to various tasks has been expanded toward various scenarios. Owing to the recent advances in generative modeling, fake data genera…

Contrastive LearningVocal Bursts Type Prediction

FedTabDiff: Federated Learning of Diffusion Probabilistic Models for Synthetic Mixed-Type Tabular Data Generation

2024-01-11 · Timur Sattarov, Marco Schreyer, Damian Borth

Realistic synthetic tabular data generation encounters significant challenges in preserving privacy, especially when dealing with sensitive information in domains like finance and healthcare. In this paper, we introduce …

AttributeDenoisingFederated LearningTabular Data Generation

Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Trees

2023-09-18 · Alexia Jolicoeur-Martineau, Kilian Fatras, Tal Kachman

Tabular data is hard to acquire and is subject to missing values. This paper introduces a novel approach for generating and imputing mixed-type (continuous and categorical) tabular data utilizing score-based diffusion an…

GPUImputationMissing ValuesTabular Data Generation