paper-with-me

홈 › Papers

STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting

2026-07-07 · Ye Zihao arxiv

Accurate station-level demand forecasting is essential for the efficient operation of bike-sharing systems, yet it remains challenging due to complex spatio-temporal dependencies and the large scale of urban networks. This paper presents STAGformer, a Spatio-Temporal Agent Graph Transformer that achieves efficient global modeling with linear computational complexity. The model introduces a two-step agent attention mechanism, where a small set of learnable spatial and temporal agent tokens first aggregate global information and then broadcast it back to individual stations and time steps, effectively capturing long-range interactions while reducing the quadratic cost of standard self-attention to O(NT). STAGformer integrates four core modules: a spatio-temporal encoder that fuses dynamic node features with external contextual factors (weather, time, points of interest), a graph propagation module for spatial neighbor aggregation, a temporal convolution module for local pattern extraction, and the agent attention module for global dependency modeling. Extensive experiments on two real-world datasets -- NYC Citi-Bike and Chicago Divvy-Bike -- demonstrate that STAGformer consistently outperforms state-of-the-art baselines across multiple prediction horizons, achieving significant improvements in both RMSE and MAE. Ablation studies validate the contribution of each component, with the agent attention mechanism proving critical for modeling global spatio-temporal dependencies.

📄 PDF Abstract BibTeX arXiv:2607.06614

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

StagFormer: Time Staggering Transformer Decoding for RunningLayers In Parallel

2025-01-26 · Dylan Cutler, Arun Kandoor, Nishanth Dikkala, Nikunj Saunshi 외

Standard decoding in a Transformer based language model is inherently sequential as we wait for a token's embedding to pass through all the layers in the network before starting the generation of the next token. In this …

S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Driving

2022-06-22 · Weihuang Chen, Fangfang Wang, Hongbin Sun

To safely and rationally participate in dense and heterogeneous traffic, autonomous vehicles require to sufficiently analyze the motion patterns of surrounding traffic-agents and accurately predict their future trajector…

Autonomous DrivingAutonomous VehiclesTrajectory Prediction

baller2vec: A Multi-Entity Transformer For Multi-Agent Spatiotemporal Modeling

2021-02-05 · NeurIPS 2021 12 · Michael A. Alcorn, Anh Nguyen

Multi-agent spatiotemporal modeling is a challenging task from both an algorithmic design and computational complexity perspective. Recent work has explored the efficacy of traditional deep sequential models in this doma…

Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction

2020-05-18 · ECCV 2020 8 · Cunjun Yu, Xiao Ma, Jiawei Ren, Haiyu Zhao 외

Understanding crowd motion dynamics is critical to real-world applications, e.g., surveillance systems and autonomous driving. This is challenging because it requires effectively modeling the socially aware crowd spatial…

Autonomous DrivingPedestrian Trajectory PredictionPredictionTrajectory Prediction

Spacetime $E(n)$-Transformer: Equivariant Attention for Spatio-temporal Graphs

2024-08-12 · Sergio G. Charles

We introduce an $E(n)$-equivariant Transformer architecture for spatio-temporal graph data. By imposing rotation, translation, and permutation equivariance inductive biases in both space and time, we show that the Spacet…

Translation