TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts
Accurate traffic forecasting is challenging due to the complex dependency on road networks, various types of roads, and the abrupt speed change due to the events. Recent works mainly focus on dynamic spatial modeling with adaptive graph embedding or graph attention having less consideration for temporal characteristics and in-situ modeling. In this paper, we propose a novel deep learning model named TESTAM, which individually models recurring and non-recurring traffic patterns by a mixture-of-experts model with three experts on temporal modeling, spatio-temporal modeling with static graph, and dynamic spatio-temporal dependency modeling with dynamic graph. By introducing different experts and properly routing them, TESTAM could better model various circumstances, including spatially isolated nodes, highly related nodes, and recurring and non-recurring events. For the proper routing, we reformulate a gating problem into a classification problem with pseudo labels. Experimental results on three public traffic network datasets, METR-LA, PEMS-BAY, and EXPY-TKY, demonstrate that TESTAM achieves a better indication and modeling of recurring and non-recurring traffic. We published the official code at https://github.com/HyunWookL/TESTAM
Code (1)
Tasks
Graph AttentionGraph EmbeddingMixture-of-ExpertsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting
Traffic forecasting is fundamental to intelligent transportation systems, enabling congestion mitigation and emission reduction in increasingly complex urban environments. While recent graph neural network approaches hav…
Computational EfficiencyGraph Neural NetworkSpatiotemporal-Enhanced Network for Click-Through Rate Prediction in Location-based Services
In Location-Based Services(LBS), user behavior naturally has a strong dependence on the spatiotemporal information, i.e., in different geographical locations and at different times, user click behavior will change signif…
AttributeClick-Through Rate PredictionSpatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring
This work presents advancements in multi-class vehicle detection using UAV cameras through the development of spatiotemporal object detection models. The study introduces a Spatio-Temporal Vehicle Detection Dataset (STVD…
Objectobject-detectionObject Detectionvehicle detectionFlow Neural Network and Flow-Structured Data Representation
Traffic flows are the most fundamental components in a communication networking system. An accurate understanding of these flows is crucial for many downstream network applications. However, the high nonlinearity, random…
Local Temporal Feature Enhanced Transformer with ROI-rank Based Masking for Diagnosis of ADHD
In modern society, Attention-Deficit/Hyperactivity Disorder (ADHD) is one of the common mental diseases discovered not only in children but also in adults. In this context, we propose a ADHD diagnosis transformer model t…