Sub-Graph Learning for Spatiotemporal Forecasting via Knowledge Distillation
One of the challenges in studying the interactions in large graphs is to learn their diverse pattern and various interaction types. Hence, considering only one distribution and model to study all nodes and ignoring their diversity and local features in their neighborhoods, might severely affect the overall performance. Based on the structural information of the nodes in the graph and the interactions between them, the main graph can be divided into multiple sub-graphs. This graph partitioning can tremendously affect the learning process, however the overall performance is highly dependent on the clustering method to avoid misleading the model. In this work, we present a new framework called KD-SGL to effectively learn the sub-graphs, where we define one global model to learn the overall structure of the graph and multiple local models for each sub-graph. We assess the performance of the proposed framework and evaluate it on public datasets. Based on the achieved results, it can improve the performance of the state-of-the-arts spatiotemporal models with comparable results compared to ensemble of models with less complexity.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityGraph Learninggraph partitioningKnowledge DistillationSimilar Papers 제목 키워드 기반
Transferable Graph Structure Learning for Graph-based Traffic Forecasting Across Cities
Graph-based deep learning models are powerful in modeling spatiotemporal graphs for traffic forecasting. In practice, accurate forecasting models rely on sufficient traffic data, which may not be accessible in real-world…
Graph structure learningKnowledge DistillationTransfer LearningS^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
Spatiotemporal forecasting often relies on computationally intensive models to capture complex dynamics. Knowledge distillation (KD) has emerged as a key technique for creating lightweight student models, with recent adv…
Knowledge DistillationA Distillation-based Future-aware Graph Neural Network for Stock Trend Prediction
Stock trend prediction involves forecasting the future price movements by analyzing historical data and various market indicators. With the advancement of machine learning, graph neural networks (GNNs) have been extensiv…
Graph Neural NetworkPredictionStock PredictionStock Trend PredictionRobust Spatiotemporal Traffic Forecasting with Reinforced Dynamic Adversarial Training
Machine learning-based forecasting models are commonly used in Intelligent Transportation Systems (ITS) to predict traffic patterns and provide city-wide services. However, most of the existing models are susceptible to …
Adversarial RobustnessKnowledge DistillationSelf-Knowledge DistillationHSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting
Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the pe…
energy managementFederated LearningRepresentation LearningTime Series+1