paper-with-me

Papers

TabGraphs: A Benchmark and Strong Baselines for Learning on Graphs with Tabular Node Features

2024-09-22 · Gleb Bazhenov, Oleg Platonov, Liudmila Prokhorenkova

Tabular machine learning is an important field for industry and science. In this field, table rows are usually treated as independent data samples, but additional information about relations between them is sometimes available and can be used to improve predictive performance. Such information can be naturally modeled with a graph, thus tabular machine learning may benefit from graph machine learning methods. However, graph machine learning models are typically evaluated on datasets with homogeneous node features, which have little in common with heterogeneous mixtures of numerical and categorical features present in tabular datasets. Thus, there is a critical difference between the data used in tabular and graph machine learning studies, which does not allow one to understand how successfully graph models can be transferred to tabular data. To bridge this gap, we propose a new benchmark of diverse graphs with heterogeneous tabular node features and realistic prediction tasks. We use this benchmark to evaluate a vast set of models, including simple methods previously overlooked in the literature. Our experiments show that graph neural networks (GNNs) can indeed often bring gains in predictive performance for tabular data, but standard tabular models also can be adapted to work with graph data by using simple feature preprocessing, which sometimes enables them to compete with and even outperform GNNs. Based on our empirical study, we provide insights for researchers and practitioners in both tabular and graph machine learning fields.

📄 PDF Abstract BibTeX arXiv:2409.14500

Code (1)

yandex-research/tabgraphs 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Can Graphs Improve Tabular Foundation Models?

2025-12-13 · Franck Le, Keith Grueneberg, Erich Nahum, Vadim Sheinin arxiv

Tabular data are central to many real-world systems. While recent tabular transformers and in-context learners such as SAINT, TP-BERTa, TabPFN, TabICL, and MITRA incorporate limited inter-row reasoning, most approaches s…

Mixture of In-Context Prompters for Tabular PFNs

2024-05-25 · Derek Xu, Olcay Cirit, Reza Asadi, Yizhou Sun 외

Recent benchmarks found In-Context Learning (ICL) outperforms both deep learning and tree-based algorithms on small tabular datasets. However, on larger datasets, ICL for tabular learning cannot run without severely comp…

Deep LearningIn-Context Learning

Turning Tabular Foundation Models into Graph Foundation Models

2025-08-28 · Dmitry Eremeev, Gleb Bazhenov, Oleg Platonov, Artem Babenko 외 arxiv

While foundation models have revolutionized fields such as natural language processing and computer vision, their potential in graph machine learning remains largely unexplored. One of the key challenges in designing gra…

Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression

2026-03-27 · Rafael Izbicki, Pedro L. C. Rodrigues arxiv

Conditional density estimation (CDE) - recovering the full conditional distribution of a response given tabular covariates - is essential in settings with heteroscedasticity, multimodality, or asymmetric uncertainty. Rec…

Density Estimation

TFMLinker: Universal Link Predictor by Graph In-Context Learning with Tabular Foundation Models

2026-02-09 · Tianyin Liao, Chunyu Hu, Yicheng Sui, Xingxuan Zhang 외 arxiv

Link prediction is a fundamental task in graph machine learning with widespread applications such as recommendation systems, drug discovery, knowledge graphs, etc. In the foundation model era, how to develop universal li…

Recommendation SystemsKnowledge GraphsLink PredictionDrug Discovery