paper-with-me

Papers

GOGGLE: Generative Modelling for Tabular Data by Learning Relational Structure

2023-10-27 · ICLR 2023 10 · Tennison Liu, Zhaozhi Qian, Jeroen Berrevoets, Mihaela van der Schaar

Deep generative models learn highly complex and non-linear representations to generate realistic synthetic data. While they have achieved notable success in computer vision and natural language processing, similar advances have been less demonstrable in the tabular domain. This is partially because generative modelling of tabular data entails a particular set of challenges, including heterogeneous relationships, limited number of samples, and difficulties in incorporating prior knowledge. Additionally, unlike their counterparts in image and sequence domain, deep generative models for tabular data almost exclusively employ fully-connected layers, which encode weak inductive biases about relationships between inputs. Real-world data generating processes can often be represented using relational structures, which encode sparse, heterogeneous relationships between variables. In this work, we learn and exploit relational structure underlying tabular data to better model variable dependence, and as a natural means to introduce regularization on relationships and include prior knowledge. Specifically, we introduce GOGGLE, an end-to-end message passing scheme that jointly learns the relational structure and corresponding functional relationships as the basis of generating synthetic samples. Using real-world datasets, we provide empirical evidence that the proposed method is effective in generating realistic synthetic data and exploiting domain knowledge for downstream tasks.

📄 PDF Abstract BibTeX

Code (2)

vanderschaarlab/goggle 공식 구현 pytorch
tennisonliu/goggle pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

GOGGLES: Automatic Image Labeling with Affinity Coding

2019-03-11 · Nilaksh Das, Sanya Chaba, Renzhi Wu, Sakshi Gandhi 외

Generating large labeled training data is becoming the biggest bottleneck in building and deploying supervised machine learning models. Recently, the data programming paradigm has been proposed to reduce the human cost i…

Few-Shot Learning

Row Conditional-TGAN for generating synthetic relational databases

2022-11-14 · Mohamed Gueye, Yazid Attabi, Maxime Dumas

Besides reproducing tabular data properties of standalone tables, synthetic relational databases also require modeling the relationships between related tables. In this paper, we propose the Row Conditional-Tabular Gener…

Generative Adversarial Network

TabPFGen -- Tabular Data Generation with TabPFN

2024-06-07 · Junwei Ma, Apoorv Dankar, George Stein, Guangwei Yu 외

Advances in deep generative modelling have not translated well to tabular data. We argue that this is caused by a mismatch in structure between popular generative models and discriminative models of tabular data. We thus…

Data AugmentationImputationIn-Context LearningTabular Data Generation

Tabular Foundation Model for Generative Modelling

2026-05-10 · Xiangjian Jiang, Mingxuan Liu, Nikola Simidjievski, Tassilo Klein 외 arxiv

Generative modelling is a demanding test of foundation models, because it requires robust, holistic representation learning for a given data modality, rather than optimisation for a supervised prediction target alone. Wh…

Representation Learning

How Well Does Your Tabular Generator Learn the Structure of Tabular Data?

2025-03-12 · Xiangjian Jiang, Nikola Simidjievski, Mateja Jamnik

Heterogeneous tabular data poses unique challenges in generative modelling due to its fundamentally different underlying data structure compared to homogeneous modalities, such as images and text. Although previous resea…