paper-with-me

홈 › Papers

Adaptation Interfaces for In-Context Tabular Foundation Models in Time-to-Event Prediction

2026-09-04 · Minh-Khoi Pham, Luca Cotugno, Dan Cernei, Alina Sirbu, Stefano Masi, Giuseppe Prencipe, Alessandro Pingitore, Patrizia Landi, Working Group on Uric Acid, Cardiovascular Risk of the Italian Society of Hypertension, Tai Tan Mai, Martin Crane, Marija Bezbradica arxiv

Tabular foundation models (TabFMs) achieve strong performance on structured data, particularly for standard classification and regression problems. Yet, extending them to censored time-to-event prediction is challenging because it requires properly handling censoring and event-time dynamics. Building on our prior work, we further link TabFMs with CoxPH and DeepHit and revise the context-resampled training procedure. We evaluate temporal zero-shot reformulation, classification-based fine-tuning, and survival-head adaptation using frozen TabFM backbones on 74 single-risk data sets, and we additionally study 4 competing-risk data sets. Zero-shot inference is effective on smaller single-risk data sets, whereas supervised adaptation becomes increasingly advantageous as data sets scale. Cox provides the most reliably strong interface, especially for Integrated Brier Score (IBS) on larger data sets. DeepHit is relatively stronger for the time-dependent Concordance Index than for IBS, while cause-specific MTLR ranks highest among the TabFM survival heads in the four-data-set competing-risk analysis. Classification fine-tuning becomes more competitive with zero-shot inference as data sets grow but remains weaker for probabilistic prediction. Overall, our results indicate that effective TabFM transfer depends on the data regime and on the statistical structure represented by the chosen adaptation interface. The implementation scripts used for this work are available at https://github.com/kaylode/survival-fm.

📄 PDF Abstract BibTeX arXiv:2609.04901

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

TabQL: In-Context Q-Learning with Tabular Foundation Models

2026-05-18 · Qisai Liu, Zhanhong Jiang, Timilehin Ayanlade, Ashutosh Kumar Nirala 외 arxiv

We propose Tabular Q-Learning (TabQL), a reinforcement learning framework that replaces the conventional parametric Q-network in Deep Q-Learning (DQN) with a tabular foundation model endowed with in-context learning capa…

Reinforcement Learning

Live Knowledge Tracing: Real-Time Adaptation using Tabular Foundation Models

2026-02-06 · Mounir Lbath, Alexandre Parésy, Abdelkayoum Kaddouri, Abdelrahman Zighem 외 arxiv

Deep knowledge tracing models have achieved significant breakthroughs in modeling student learning trajectories. However, these architectures require substantial training time and are prone to overfitting on datasets wit…

Knowledge Tracing

On Finetuning Tabular Foundation Models

2025-06-10 · Ivan Rubachev, Akim Kotelnikov, Nikolay Kartashev, Artem Babenko

Foundation models are an emerging research direction in tabular deep learning. Notably, TabPFNv2 recently claimed superior performance over traditional GBDT-based methods on small-scale datasets using an in-context learn…

In-Context LearningRetrieval

TabTune: A Unified Library for Inference and Fine-Tuning Tabular Foundation Models

2025-11-04 · Aditya Tanna, Pratinav Seth, Mohamed Bouadi, Utsav Avaiya 외 arxiv

Tabular foundation models represent a growing paradigm in structured data learning, extending the benefits of large-scale pretraining to tabular domains. However, their adoption remains limited due to heterogeneous prepr…

parameter-efficient fine-tuning

Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models

2026-06-03 · Raffael Theiler, Lev Telyatnikov, Leandro Von Krannichfeldt, Olga Fink arxiv

Data-driven Prognostics and Health Management (PHM) uses time-varying condition-monitoring data to diagnose system states and estimate remaining useful life in engineered assets. These tasks are central to maintenance pl…