Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Trees
Tabular data is hard to acquire and is subject to missing values. This paper introduces a novel approach for generating and imputing mixed-type (continuous and categorical) tabular data utilizing score-based diffusion and conditional flow matching. In contrast to prior methods that rely on neural networks to learn the score function or the vector field, we adopt XGBoost, a widely used Gradient-Boosted Tree (GBT) technique. To test our method, we build one of the most extensive benchmarks for tabular data generation and imputation, containing 27 diverse datasets and 9 metrics. Through empirical evaluation across the benchmark, we demonstrate that our approach outperforms deep-learning generation methods in data generation tasks and remains competitive in data imputation. Notably, it can be trained in parallel using CPUs without requiring a GPU. Our Python and R code is available at https://github.com/SamsungSAILMontreal/ForestDiffusion.
Code (5)
Tasks
GPUImputationMissing ValuesTabular Data GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ReMasker: Imputing Tabular Data with Masked Autoencoding
We present ReMasker, a new method of imputing missing values in tabular data by extending the masked autoencoding framework. Compared with prior work, ReMasker is both simple -- besides the missing values (i.e., naturall…
ImputationMissing ValuesLLM-TabFlow: Synthetic Tabular Data Generation with Inter-column Logical Relationship Preservation
Synthetic tabular data have widespread applications in industrial domains such as healthcare, finance, and supply chains, owing to their potential to protect privacy and mitigate data scarcity. However, generating realis…
Large Language ModelTabular Data GenerationSketchFill: Sketch-Guided Code Generation for Imputing Derived Missing Values
Missing value is a critical issue in data science, significantly impacting the reliability of analyses and predictions. Missing value imputation (MVI) is a longstanding problem because it highly relies on domain knowledg…
Code GenerationImputationIn-Context LearningMissing ValuesCascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features
Advances in generative modeling have recently been adapted to tabular data containing discrete and continuous features. However, generating mixed-type features that combine discrete states with an otherwise continuous di…
AutoDiff: combining Auto-encoder and Diffusion model for tabular data synthesizing
Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power …
Language ModelingLanguage ModellingSpeech SynthesisSynthetic Data Generation