Capturing Complex Spatial-Temporal Dependencies in Traffic Forecasting: A Self-Attention Approach
We study the problem of traffic forecasting, aiming to predict the inflow and outflow of a region in the subsequent time slot. The problem is complex due to the intricate spatial and temporal interdependence among regions. Prior works study the spatial and temporal dependency in a decouple manner, failing to capture their joint effect. In this work, we propose ST-SAM, a novel and efficient Spatial-Temporal Self-Attention Model for traffic forecasting. ST-SAM uses a region embedding layer to learn time-specific embedding from traffic data for regions. Then, it employs a spatial-temporal dependency learning module based on self-attention mechanism to capture the joint spatial-temporal dependency for both nearby and faraway regions. ST-SAM entirely relies on self-attention to capture both local and global spatial-temporal correlations, which make it effective and efficient. Extensive experiments on two real world datasets show that ST-SAM is substantially more accurate and efficient than the state-of-the-art approaches (with an average improvement of up to 15% on RMSE, 17% on MAPE, and 32 times on training time in our experiments).
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multi-Scale Spatial-Temporal Recurrent Networks for Traffic Flow Prediction
Traffic flow prediction is one of the most fundamental tasks of intelligent transportation systems. The complex and dynamic spatial-temporal dependencies make the traffic flow prediction quite challenging. Although exist…
PredictionHybrid Transformer and Spatial-Temporal Self-Supervised Learning for Long-term Traffic Prediction
Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-tem…
Data AugmentationSelf-Supervised LearningTraffic PredictionSpatial-Temporal Hypergraph Neural Network for Traffic Forecasting
Traffic forecasting, which benefits from mobile Internet development and position technologies, plays a critical role in Intelligent Transportation Systems. It helps to implement rich and varied transportation applicatio…
Attention-based Spatial-Temporal Graph Convolutional Recurrent Networks for Traffic Forecasting
Traffic forecasting is one of the most fundamental problems in transportation science and artificial intelligence. The key challenge is to effectively model complex spatial-temporal dependencies and correlations in moder…
Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Network
Accurate forecasting of citywide traffic flow has been playing critical role in a variety of spatial-temporal mining applications, such as intelligent traffic control and public risk assessment. While previous work has m…
Traffic Prediction