paper-with-me

홈 › Papers

Continual Traffic Forecasting via Mixture of Experts

2024-06-05 · SangHyun Lee, Chanyoung Park

The real-world traffic networks undergo expansion through the installation of new sensors, implying that the traffic patterns continually evolve over time. Incrementally training a model on the newly added sensors would make the model forget the past knowledge, i.e., catastrophic forgetting, while retraining the model on the entire network to capture these changes is highly inefficient. To address these challenges, we propose a novel Traffic Forecasting Mixture of Experts (TFMoE) for traffic forecasting under evolving networks. The main idea is to segment the traffic flow into multiple homogeneous groups, and assign an expert model responsible for a specific group. This allows each expert model to concentrate on learning and adapting to a specific set of patterns, while minimizing interference between the experts during training, thereby preventing the dilution or replacement of prior knowledge, which is a major cause of catastrophic forgetting. Through extensive experiments on a real-world long-term streaming network dataset, PEMSD3-Stream, we demonstrate the effectiveness and efficiency of TFMoE. Our results showcase superior performance and resilience in the face of catastrophic forgetting, underscoring the effectiveness of our approach in dealing with continual learning for traffic flow forecasting in long-term streaming networks.

📄 PDF Abstract BibTeX arXiv:2406.03140

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningMixture-of-Experts

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting

2026-05-28 · Amirhossein Ghaffari, Saeid Sheikhi, Ekaterina Gilman arxiv

Spatio-temporal forecasting on sensor graphs is commonly tackled with a single backbone architecture applied uniformly across all nodes, although graph regions can exhibit different dynamics. Road segments differ in func…

Graph Neural Network

Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting

2024-08-20 · Jianxiang Zhou, Erdong Liu, Wei Chen, Siru Zhong 외

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face tw…

AttributeMixture-of-Experts

TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts

2024-03-05 · Hyunwook Lee, Sungahn Ko

Accurate traffic forecasting is challenging due to the complex dependency on road networks, various types of roads, and the abrupt speed change due to the events. Recent works mainly focus on dynamic spatial modeling wit…

Graph AttentionGraph EmbeddingMixture-of-Experts

From XXLTraffic to EvoXXLTraffic: Scaling Traffic Forecasting to Sensor-Evolving Networks

2026-05-28 · Du Yin, Hao Xue, Arian Prabowo, Shuang Ao 외 arxiv

Existing traffic forecasting benchmarks assume a fixed sensor set, but real road-sensor networks grow continuously as the road network changes year by year. We introduce the XXLTraffic dataset family, which spans up to 2…

MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting

2026-01-31 · Hyekyung Yoon, Minhyuk Lee, Imseung Park, Myungjoo Kang arxiv

Multivariate long-term time series forecasting (LTSF) supports critical applications such as traffic-flow management, solar-power scheduling, and electricity-transformer monitoring. The existing LTSF paradigms follow a t…

Time Series Forecasting