paper-with-me

Papers

FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction

2026-04-15 · Xinjin Li, Jinghan Cao, Mengyue Wang, Yue Wu, Longxiang Yan, Yeyang Zhou, Ziqi Sha, Yu Ma arxiv

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models capture global dependencies well but suffer from quadratic complexity, while recent selective state-space models are computationally efficient yet less effective at modeling spatial interactions in graph-structured traffic data. We propose FAST, a unified framework that combines attention and state-space modeling for scalable spatiotemporal traffic forecasting. FAST adopts a Temporal-Spatial-Temporal architecture, where temporal attention modules capture both short- and long-term temporal patterns, and a Mamba-based spatial module models long-range inter-sensor dependencies with linear complexity. To better represent heterogeneous traffic contexts, FAST further introduces a learnable multi-source spatiotemporal embedding that integrates historical traffic flow, temporal context, and node-level information, together with a multi-level skip prediction mechanism for hierarchical feature fusion. Experiments on PeMS04, PeMS07, and PeMS08 show that FAST consistently outperforms strong baselines from Transformer-, GNN-, attention-, and Mamba-based families. In particular, FAST achieves the best MAE and RMSE on all three benchmarks, with up to 4.3\% lower RMSE and 2.8\% lower MAE than the strongest baseline, demonstrating a favorable balance between accuracy, scalability, and generalization.

📄 PDF Abstract BibTeX arXiv:2604.13453

Code (0)

등록된 구현이 없습니다.

Tasks

Traffic Prediction

Similar Papers 제목 키워드 기반

A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observation

2025-07-08 · Yuxin Zhang, Jiahao Yang, Zhe Chen, Wenjun Zhu 외 arxiv

Recently, large vision-language models (LVLMs) unleash powerful analysis capabilities for low Earth orbit (LEO) satellite Earth observation images in the data center. However, fast satellite motion, brief satellite-groun…

MD-Syn: Synergistic drug combination prediction based on the multidimensional feature fusion method and attention mechanisms

2025-01-14 · XinXin Ge, Yi-Ting Lee, Shan-Ju Yeh

Drug combination therapies have shown promising therapeutic efficacy in complex diseases and have demonstrated the potential to reduce drug resistance. However, the huge number of possible drug combinations makes it diff…

Learning Synergistic Attention for Light Field Salient Object Detection

2021-04-28 · Yi Zhang, Geng Chen, Qian Chen, Yujia Sun 외

We propose a novel Synergistic Attention Network (SA-Net) to address the light field salient object detection by establishing a synergistic effect between multi-modal features with advanced attention mechanisms. Our SA-N…

Objectobject-detectionObject DetectionSalient Object Detection

STAR-Rec: Making Peace with Length Variance and Pattern Diversity in Sequential Recommendation

2025-05-06 · Maolin Wang, Sheng Zhang, Ruocheng Guo, Wanyu Wang 외

Recent deep sequential recommendation models often struggle to effectively model key characteristics of user behaviors, particularly in handling sequence length variations and capturing diverse interaction patterns. We p…

DiversityMixture-of-ExpertsSequential Recommendation

TransXSSM: A Hybrid Transformer State Space Model with Unified Rotary Position Embedding

2025-06-11 · Bingheng Wu, Jingze Shi, Yifan Wu, Nan Tang 외

Transformers exhibit proficiency in capturing long-range dependencies, whereas State Space Models (SSMs) facilitate linear-time sequence modeling. Notwithstanding their synergistic potential, the integration of these arc…

4kLanguage ModelingLanguage ModellingPosition+1