paper-with-me

Papers

Schema-Adaptive Tabular Representation Learning with LLMs for Generalizable Multimodal Clinical Reasoning

2026-04-12 · Hongxi Mao, Wei Zhou, Mengting Jia, Tao Fang, Huan Gao, Bin Zhang, Shangyang Li arxiv

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine, where electronic health record (EHR) schemas vary significantly. To solve this problem, we propose Schema-Adaptive Tabular Representation Learning, a novel method that leverages large language models (LLMs) to create transferable tabular embeddings. By transforming structured variables into semantic natural language statements and encoding them with a pretrained LLM, our approach enables zero-shot alignment across unseen schemas without manual feature engineering or retraining. We integrate our encoder into a multimodal framework for dementia diagnosis, combining tabular and MRI data. Experiments on NACC and ADNI datasets demonstrate state-of-the-art performance and successful zero-shot transfer to unseen schemas, significantly outperforming clinical baselines, including board-certified neurologists, in retrospective diagnostic tasks. These results validate our LLM-driven approach as a scalable, robust solution for heterogeneous real-world data, offering a pathway to extend LLM-based reasoning to structured domains.

📄 PDF Abstract BibTeX arXiv:2604.11835

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningFeature Engineering

Similar Papers 제목 키워드 기반

Conceptual Schema Inference for Tabular Datasets using Large Language Models

2025-09-04 · Zhenyu Wu, Jiaoyan Chen, Norman W. Paton arxiv

Large collections of tabular data from data lakes, web tables and open data portals often originate from heterogeneous sources, leading to representational inconsistencies. Understanding and organizing such repositories …

Scalable In-Context Learning on Tabular Data via Retrieval-Augmented Large Language Models

2025-02-05 · Xumeng Wen, Shun Zheng, Zhen Xu, Yiming Sun 외

Recent studies have shown that large language models (LLMs), when customized with post-training on tabular data, can acquire general tabular in-context learning (TabICL) capabilities. These models are able to transfer ef…

In-Context LearningRetrieval

PIPER: Content-Based Table Search via profiling and LLM-Generated Pseudoqueries

2026-05-18 · Riccardo Terrenzi, Matteo Falconi, Serkan Ayvaz, Pierluigi Plebani arxiv

The rapid growth of tabular datasets in data lakes, data spaces, and open data portals makes effective dataset search essential for reuse and analysis. Existing search systems rely mainly on metadata, which is often inco…

Question Answering

TabGemma: Text-Based Tabular ICL via LLM using Continued Pretraining and Retrieval

2025-11-05 · Günther Schindler, Maximilian Schambach, Michael Medek, Sam Thelin arxiv

We study LLMs for tabular prediction with mixed text, numeric, and categorical fields. We introduce TabGemma, a schema-agnostic in-context learner that treats rows as sequences and tackles two practical hurdles when adap…

Do You Really Need Public Data? Surrogate Public Data for Differential Privacy on Tabular Data

2025-04-19 · Shlomi Hod, Lucas Rosenblatt, Julia Stoyanovich

Differentially private (DP) machine learning often relies on the availability of public data for tasks like privacy-utility trade-off estimation, hyperparameter tuning, and pretraining. While public data assumptions may …