Temporal Graph Benchmark for Machine Learning on Temporal Graphs
We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale, spanning years in duration, incorporate both node and edge-level prediction tasks and cover a diverse set of domains including social, trade, transaction, and transportation networks. For both tasks, we design evaluation protocols based on realistic use-cases. We extensively benchmark each dataset and find that the performance of common models can vary drastically across datasets. In addition, on dynamic node property prediction tasks, we show that simple methods often achieve superior performance compared to existing temporal graph models. We believe that these findings open up opportunities for future research on temporal graphs. Finally, TGB provides an automated machine learning pipeline for reproducible and accessible temporal graph research, including data loading, experiment setup and performance evaluation. TGB will be maintained and updated on a regular basis and welcomes community feedback. TGB datasets, data loaders, example codes, evaluation setup, and leaderboards are publicly available at https://tgb.complexdatalab.com/.
Code (6)
Tasks
Node Property PredictionProperty PredictionSimilar Papers 제목 키워드 기반
Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs
Interest has been rising lately towards modeling time-evolving knowledge graphs (KGs) with the rapid growth of heterogeneous event data. Recently, graph representation learning approaches have become the dominant paradig…
Graph Representation LearningKnowledge GraphsLink PredictionRepresentation LearningTGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphs
Multi-relational temporal graphs are powerful tools for modeling real-world data, capturing the evolving and interconnected nature of entities over time. Recently, many novel models are proposed for ML on such graphs int…
BenchmarkingKnowledge GraphsTemporal Graphs Anomaly Emergence Detection: Benchmarking For Social Media Interactions
Temporal graphs have become an essential tool for analyzing complex dynamic systems with multiple agents. Detecting anomalies in temporal graphs is crucial for various applications, including identifying emerging trends,…
Anomaly DetectionBenchmarkingInductive Representation Learning on Temporal Graphs
Inductive representation learning on temporal graphs is an important step toward salable machine learning on real-world dynamic networks. The evolving nature of temporal dynamic graphs requires handling new nodes as well…
Graph AttentionGraph EmbeddingLink PredictionNode Classification+1Synthetic Datasets for Machine Learning on Spatio-Temporal Graphs using PDEs
Many physical processes can be expressed through partial differential equations (PDEs). Real-world measurements of such processes are often collected at irregularly distributed points in space, which can be effectively r…
BenchmarkingEpidemiology