Temporal Knowledge Graph Forecasting under Distribution Shifts: A Synthetic Evaluation
Temporal knowledge graphs (TKGs) represent evolving relational systems, whose underlying data-generating processes often change over time. Yet, TKG forecasting models are commonly evaluated only on empirical benchmark datasets that provide limited insight into the models' robustness to such distribution shifts. Recognising this issue, we study TKG forecasting under controlled shift environments using a synthetic TKG generator that encodes three temporal and structural properties -- recurrence, homophily, and periodicity -- as data-generating mechanisms. This allows us to evaluate seven forecasting architectures under stationary and shifting regimes. Our experiments suggest that robustness in TKG forecasting is highly signal-dependent. Recurrence-based and periodic regularities are largely recoverable under stationary conditions, and simple memory-based baselines can be competitive when recurrence dominates the data. However, structural breaks reveal limitations in model adaptivity, with shifts in latent entity-community structure posing the strongest challenge in our study. Overall, our findings improve the understanding of the capabilities and limitations of current TKG models confronted with temporal distribution shifts.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsSimilar Papers 제목 키워드 기반
Transferable Graph Structure Learning for Graph-based Traffic Forecasting Across Cities
Graph-based deep learning models are powerful in modeling spatiotemporal graphs for traffic forecasting. In practice, accurate forecasting models rely on sufficient traffic data, which may not be accessible in real-world…
Graph structure learningKnowledge DistillationTransfer LearningExplainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs
Interest has been rising lately towards modeling time-evolving knowledge graphs (KGs) with the rapid growth of heterogeneous event data. Recently, graph representation learning approaches have become the dominant paradig…
Graph Representation LearningKnowledge GraphsLink PredictionRepresentation LearningxERTE: Explainable Reasoning on Temporal Knowledge Graphs for Forecasting Future Links
Modeling time-evolving knowledge graphs (KGs) has recently gained increasing interest. Here, graph representation learning has become the dominant paradigm for link prediction on temporal KGs. However, the embedding-base…
Graph Representation LearningKnowledge GraphsLink PredictionRepresentation LearningIgnite Forecasting with SPARK: An Efficient Generative Framework for Refining LLMs in Temporal Knowledge Graph Forecasting
Temporal Knowledge Graph (TKG) forecasting is crucial for predicting future events using historical data. With the surge of Large Language Models (LLMs), recent studies have begun exploring their integration into TKG for…
KST-GCN: A Knowledge-Driven Spatial-Temporal Graph Convolutional Network for Traffic Forecasting
While considering the spatial and temporal features of traffic, capturing the impacts of various external factors on travel is an essential step towards achieving accurate traffic forecasting. However, existing studies s…
Knowledge GraphsRepresentation Learning