paper-with-me

홈 › Papers

Bridging Input Feature Spaces Towards Graph Foundation Models

2026-05-06 · Moshe Eliasof, Krishna Sri Ipsit Mantri, Beatrice Bevilacqua, Bruno Ribeiro, Carola-Bibiane Schönlieb arxiv

Unlike vision and language domains, graph learning lacks a shared input space, as input features differ across graph datasets not only in semantics, but also in value ranges and dimensionality. This misalignment prevents graph models from generalizing across datasets, limiting their use as foundation models. In this work, we propose ALL-IN, a simple and theoretically grounded method that enables transferability across datasets with different input features. Our approach projects node features into a shared random space and constructs representations via covariance-based statistics, thus eliminating dependence on the original feature space. We show that the computed node-covariance operators and the resulting node representations are invariant in distribution to permutations of the input features. We further demonstrate that the expected operator exhibits invariance to general orthogonal transformations of the input features. Empirically, ALL-IN achieves strong performance across diverse node- and graph-level tasks on unseen datasets with new input features, without requiring architecture changes or retraining. These results point to a promising direction for input-agnostic, transferable graph models.

📄 PDF Abstract BibTeX arXiv:2605.04834

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Learning

Similar Papers 제목 키워드 기반

Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networks

2026-08-09 · Omer Yom-Tov, Avigdor Gal arxiv

A central obstacle in building graph foundation models is the input heterogeneity in terms of feature space dimensionality, semantics, and structure. Such heterogeneity limits the capability of graph neural networks to g…

Inductive Link Prediction

Bridging Geometric and Semantic Foundation Models for Generalized Monocular Depth Estimation

2025-05-29 · Sanggyun Ma, Wonjoon Choi, Jihun Park, Jaeyeul Kim 외

We present Bridging Geometric and Semantic (BriGeS), an effective method that fuses geometric and semantic information within foundation models to enhance Monocular Depth Estimation (MDE). Central to BriGeS is the Bridgi…

Depth EstimationMonocular Depth Estimation

Structure-Centric Graph Foundation Model via Geometric Bases

2026-05-09 · Xiaodong He, Haolan He, Ruiyi Fang, Ming Sun 외 arxiv

Graph foundation models (GFMs) seek transferable representations across graph domains but are limited by structural heterogeneity and incompatible node feature spaces. We propose Structure-Centric Graph Foundation Models…

Domain Generalization

Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approach

2026-02-04 · Sicheng Liu, Xunkai Li, Daohan Su, Ru Zhang 외 arxiv

Graph Foundation Models (GFMs) have achieved remarkable success in generalizing across diverse domains. However, they mainly focus on Text-Attributed Graphs (TAGs), leaving Multimodal-Attributed Graphs (MAGs) largely unt…

Foundations of Population-Based SHM, Part IV: The Geometry of Spaces of Structures and their Feature Spaces

2021-03-05 · George Tsialiamanis, Charilaos Mylonas, Eleni Chatzi, Nikolaos Dervilis 외

One of the requirements of the population-based approach to Structural Health Monitoring (SHM) proposed in the earlier papers in this sequence, is that structures be represented by points in an abstract space. Furthermor…

Structural Health Monitoring