paper-with-me

홈 › Papers

Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Trees

2023-09-18 · Alexia Jolicoeur-Martineau, Kilian Fatras, Tal Kachman

Tabular data is hard to acquire and is subject to missing values. This paper introduces a novel approach for generating and imputing mixed-type (continuous and categorical) tabular data utilizing score-based diffusion and conditional flow matching. In contrast to prior methods that rely on neural networks to learn the score function or the vector field, we adopt XGBoost, a widely used Gradient-Boosted Tree (GBT) technique. To test our method, we build one of the most extensive benchmarks for tabular data generation and imputation, containing 27 diverse datasets and 9 metrics. Through empirical evaluation across the benchmark, we demonstrate that our approach outperforms deep-learning generation methods in data generation tasks and remains competitive in data imputation. Notably, it can be trained in parallel using CPUs without requiring a GPU. Our Python and R code is available at https://github.com/SamsungSAILMontreal/ForestDiffusion.

📄 PDF Abstract BibTeX arXiv:2309.09968

Code (5)

SamsungSAILMontreal/ForestDiffusion 공식 구현 pytorch
atong01/conditional-flow-matching 공식 구현 pytorch
AngeClementAkazan/Sequential-FeatureForestFlow
calvinmccarter/unmasking-trees pytorch
layer6ai-labs/calo-forest

Tasks

GPUImputationMissing ValuesTabular Data Generation

Methods 이 논문이 사용한 방법론

Library 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

ReMasker: Imputing Tabular Data with Masked Autoencoding

2023-09-25 · Tianyu Du, Luca Melis, Ting Wang

We present ReMasker, a new method of imputing missing values in tabular data by extending the masked autoencoding framework. Compared with prior work, ReMasker is both simple -- besides the missing values (i.e., naturall…

ImputationMissing Values

LLM-TabFlow: Synthetic Tabular Data Generation with Inter-column Logical Relationship Preservation

2025-03-04 · Yunbo Long, Liming Xu, Alexandra Brintrup

Synthetic tabular data have widespread applications in industrial domains such as healthcare, finance, and supply chains, owing to their potential to protect privacy and mitigate data scarcity. However, generating realis…

Large Language ModelTabular Data Generation

SketchFill: Sketch-Guided Code Generation for Imputing Derived Missing Values

2024-12-26 · Yunfan Zhang, Changlun Li, Yuyu Luo, Nan Tang

Missing value is a critical issue in data science, significantly impacting the reliability of analyses and predictions. Missing value imputation (MVI) is a longstanding problem because it highly relies on domain knowledg…

Code GenerationImputationIn-Context LearningMissing Values

Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features

2026-01-30 · Markus Mueller, Kathrin Gruber, Dennis Fok arxiv

Advances in generative modeling have recently been adapted to tabular data containing discrete and continuous features. However, generating mixed-type features that combine discrete states with an otherwise continuous di…

AutoDiff: combining Auto-encoder and Diffusion model for tabular data synthesizing

2023-10-24 · Namjoon Suh, Xiaofeng Lin, Din-Yin Hsieh, Merhdad Honarkhah 외

Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power …

Language ModelingLanguage ModellingSpeech SynthesisSynthetic Data Generation