Between-Sample Relationship in Learning Tabular Data Using Graph and Attention Networks
Traditional machine learning assumes samples in tabular data to be independent and identically distributed (i.i.d). This assumption may miss useful information within and between sample relationships in representation learning. This paper relaxes the i.i.d assumption to learn tabular data representations by incorporating between-sample relationships for the first time using graph neural networks (GNN). We investigate our hypothesis using several GNNs and state-of-the-art (SOTA) deep attention models to learn the between-sample relationship on ten tabular data sets by comparing them to traditional machine learning methods. GNN methods show the best performance on tabular data with large feature-to-sample ratios. Our results reveal that attention-based GNN methods outperform traditional machine learning on five data sets and SOTA deep tabular learning methods on three data sets. Between-sample learning via GNN and deep attention methods yield the best classification accuracy on seven of the ten data sets. This suggests that the i.i.d assumption may not always hold for most tabular data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep AttentionRepresentation LearningSimilar Papers 제목 키워드 기반
Towards a Relationship-Aware Transformer for Tabular Data
Deep learning models for tabular data typically do not allow for imposing a graph of external dependencies between samples, which can be useful for accounting for relatedness in tasks such as treatment effect estimation.…
X2Graph for Cancer Subtyping Prediction on Biological Tabular Data
Despite the transformative impact of deep learning on text, audio, and image datasets, its dominance in tabular data, especially in the medical domain where data are often scarce, remains less clear. In this paper, we pr…
Deep LearningNovel Representation Learning Technique using Graphs for Performance Analytics
The performance analytics domain in High Performance Computing (HPC) uses tabular data to solve regression problems, such as predicting the execution time. Existing Machine Learning (ML) techniques leverage the correlati…
Feature EngineeringGraph Neural NetworkMissing ValuesRepresentation LearningTAROT: Task-Adaptive Refinement of LLM-prior Graphs for Few-shot Tabular Learning
Few-shot tabular learning provides a cost-effective approach for real-world applications where annotation is costly and collecting sufficient samples for new tasks is difficult. Existing Traditional and LLM-based methods…
GOGGLE: Generative Modelling for Tabular Data by Learning Relational Structure
Deep generative models learn highly complex and non-linear representations to generate realistic synthetic data. While they have achieved notable success in computer vision and natural language processing, similar advanc…