MSCMHMST: A traffic flow prediction model based on Transformer

2025-03-16 · Weiyang Geng, Yiming Pan, Zhecong Xing, Dongyu Liu, Rui Liu, Yuan Zhu

This study proposes a hybrid model based on Transformers, named MSCMHMST, aimed at addressing key challenges in traffic flow prediction. Traditional single-method approaches show limitations in traffic prediction tasks, whereas hybrid methods, by integrating the strengths of different models, can provide more accurate and robust predictions. The MSCMHMST model introduces a multi-head, multi-scale attention mechanism, allowing the model to parallel process different parts of the data and learn its intrinsic representations from multiple perspectives, thereby enhancing the model's ability to handle complex situations. This mechanism enables the model to capture features at various scales effectively, understanding both short-term changes and long-term trends. Verified through experiments on the PeMS04/08 dataset with specific experimental settings, the MSCMHMST model demonstrated excellent robustness and accuracy in long, medium, and short-term traffic flow predictions. The results indicate that this model has significant potential, offering a new and effective solution for the field of traffic flow prediction.

📄 PDF Abstract BibTeX arXiv:2503.13540

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction Traffic Prediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Counterfactual Graph Transformer for Traffic Flow Prediction

2023-08-01 · Ying Yang, Kai Du, Xingyuan Dai, Jianwu Fang

Traffic flow prediction (TFP) is a fundamental problem of the Intelligent Transportation System (ITS), as it models the latent spatial-temporal dependency of traffic flow for potential congestion prediction. Recent graph…

counterfactual Prediction

Short-term passenger flow prediction for multi-traffic modes: A Transformer and residual network based multi-task learning method

2022-02-27 · Yongjie Yang, Jinlei Zhang, Lixing Yang, Xiaohong Li 외

With the prevailing of mobility as a service (MaaS), it becomes increasingly important to manage multi-traffic modes simultaneously and cooperatively. As an important component of MaaS, short-term passenger flow predicti…

Multi-Task Learning

Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction

2023-10-12 · Xiao Xu, Lei Zhang, Bailong Liu, Zhizhen Liang 외

As a core technology of Intelligent Transportation System (ITS), traffic flow prediction has a wide range of applications. Traffic flow data are spatial-temporal, which are not only correlated to spatial locations in roa…

Incremental Learning Knowledge Distillation Prediction

PPTNet: A Hybrid Periodic Pattern-Transformer Architecture for Traffic Flow Prediction and Congestion Identification

2025-05-19 · Hongrui Kou, Jingkai Li, Ziyu Wang, Zhouhang Lv 외

Accurate prediction of traffic flow parameters and real time identification of congestion states are essential for the efficient operation of intelligent transportation systems. This paper proposes a Periodic Pattern Tra…

Decoder Prediction Traffic Prediction

ST-MambaSync: The Complement of Mamba and Transformers for Spatial-Temporal in Traffic Flow Prediction

2024-04-24 · Zhiqi Shao, Xusheng Yao, Ze Wang, Junbin Gao

Accurate traffic flow prediction is crucial for optimizing traffic management, enhancing road safety, and reducing environmental impacts. Existing models face challenges with long sequence data, requiring substantial mem…

Computational Efficiency Mamba Management Prediction+1