paper-with-me

Papers

TabPFN Extensions for Interpretable Geotechnical Modelling

2026-03-22 · Taiga Saito, Yu Otake, Daijiro Mizutani, Stephen Wu arxiv

Geotechnical site characterisation relies on sparse, heterogeneous borehole data, where uncertainty quantification and interpretability matter as much as predictive accuracy. We evaluate TabPFN~\citep{Hollmann2025}, a tabular foundation model, and its \texttt{tabpfn-extensions} library on two geotechnical tasks: (1) soil-type classification from N-value and shear-wave velocity data as a controlled illustrative case, and (2) iterative imputation of five mechanical parameters ($s_\mathrm{u}$, $E_{\mathrm{u}}$, ${σ'}_\mathrm{p}$, $C_\mathrm{c}$, $C_\mathrm{v}$) in BM/AirportSoilProperties/2/2025. Without retraining, we apply cosine-similarity analysis to TabPFN embeddings, visualise predictive distributions, and compute SHAP attributions. On the regression benchmark we compare TabPFN with mean imputation, linear regression, random forests, XGBoost, and HBM; introduce a proxy decomposition of predictive uncertainty across context-perturbation classes; and propagate marginal $C_\mathrm{c}$ and ${σ'}_\mathrm{p}$ distributions through a one-dimensional consolidation model to obtain the reliability index $β$ and serviceability exceedance probability $P_\mathrm{f}$. Embeddings exhibit label-consistent Clay/Sand grouping; iterative imputation reduces RMSE for all five targets, with TabPFN lowest on four; SHAP attributions are consistent with the Skempton compression-index correlation and the inverse preconsolidation-pressure-water-content dependence; the within-posterior component is largest in the proxy decomposition. We position the contribution as a worked evaluation workflow that may complement established methods for data-scarce geotechnics, not as algorithmic innovation.

📄 PDF Abstract BibTeX arXiv:2603.21033

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Tabular foundation model for GEOAI benchmark problems BM/AirportSoilProperties/2/2025

2025-09-03 · Taiga Saito, Yu Otake, Stephen Wu arxiv

This paper presents a novel application of the Tabular Prior-Data Fitted Network (TabPFN) - a transformer-based foundation model for tabular data - to geotechnical site characterization problems defined in the GEOAI benc…

TabPFGen -- Tabular Data Generation with TabPFN

2024-06-07 · Junwei Ma, Apoorv Dankar, George Stein, Guangwei Yu 외

Advances in deep generative modelling have not translated well to tabular data. We argue that this is caused by a mismatch in structure between popular generative models and discriminative models of tabular data. We thus…

Data AugmentationImputationIn-Context LearningTabular Data Generation

Interpretable Machine Learning for TabPFN

2024-03-16 · David Rundel, Julius Kobialka, Constantin von Crailsheim, Matthias Feurer 외

The recently developed Prior-Data Fitted Networks (PFNs) have shown very promising results for applications in low-data regimes. The TabPFN model, a special case of PFNs for tabular data, is able to achieve state-of-the-…

Data ValuationIn-Context LearningInterpretable Machine Learning

Does TabPFN Understand Causal Structures?

2025-11-10 · Omar Swelam, Lennart Purucker, Jake Robertson, Hanne Raum 외 arxiv

Causal discovery is fundamental for multiple scientific domains, yet extracting causal information from real world data remains a significant challenge. Given the recent success on real data, we investigate whether TabPF…

Kriging prior Regression: A Case for Kriging-Based Spatial Features with TabPFN in Soil Mapping

2025-09-11 · Jonas Schmidinger, Viacheslav Barkov, Sebastian Vogel, Martin Atzmueller 외 arxiv

Machine learning and geostatistics are two fundamentally different frameworks for predicting and spatially mapping soil properties. Geostatistics leverages the spatial structure of soil properties, while machine learning…