TabMT: Generating tabular data with masked transformers
Autoregressive and Masked Transformers are incredibly effective as generative models and classifiers. While these models are most prevalent in NLP, they also exhibit strong performance in other domains, such as vision. This work contributes to the exploration of transformer-based models in synthetic data generation for diverse application domains. In this paper, we present TabMT, a novel Masked Transformer design for generating synthetic tabular data. TabMT effectively addresses the unique challenges posed by heterogeneous data fields and is natively able to handle missing data. Our design leverages improved masking techniques to allow for generation and demonstrates state-of-the-art performance from extremely small to extremely large tabular datasets. We evaluate TabMT for privacy-focused applications and find that it is able to generate high quality data with superior privacy tradeoffs.
Code (0)
등록된 구현이 없습니다.
Tasks
Synthetic Data GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Beyond Individual Input for Deep Anomaly Detection on Tabular Data
Anomaly detection is vital in many domains, such as finance, healthcare, and cybersecurity. In this paper, we propose a novel deep anomaly detection method for tabular data that leverages Non-Parametric Transformers (NPT…
Anomaly DetectionCan Graphs Improve Tabular Foundation Models?
Tabular data are central to many real-world systems. While recent tabular transformers and in-context learners such as SAINT, TP-BERTa, TabPFN, TabICL, and MITRA incorporate limited inter-row reasoning, most approaches s…
Diffusion Transformers for Tabular Data Time Series Generation
Tabular data generation has recently attracted a growing interest due to its different application scenarios. However, generating time series of tabular data, where each element of the series depends on the others, remai…
Tabular Data GenerationTime SeriesTime Series GenerationVideo GenerationTAEGAN: Generating Synthetic Tabular Data For Data Augmentation
Synthetic tabular data generation has gained significant attention for its potential in data augmentation, software testing and privacy-preserving data sharing. However, most research has primarily focused on larger data…
Data AugmentationGenerative Adversarial NetworkPrivacy Preservingsoftware testing+1MEDFuse: Multimodal EHR Data Fusion with Masked Lab-Test Modeling and Large Language Models
Electronic health records (EHRs) are multimodal by nature, consisting of structured tabular features like lab tests and unstructured clinical notes. In real-life clinical practice, doctors use complementary multimodal EH…
Decision MakingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION