paper-with-me

Papers

Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow Forecasting

2022-07-09 · Aosong Feng, Leandros Tassiulas

Traffic flow forecasting on graphs has real-world applications in many fields, such as transportation system and computer networks. Traffic forecasting can be highly challenging due to complex spatial-temporal correlations and non-linear traffic patterns. Existing works mostly model such spatial-temporal dependencies by considering spatial correlations and temporal correlations separately and fail to model the direct spatial-temporal correlations. Inspired by the recent success of transformers in the graph domain, in this paper, we propose to directly model the cross-spatial-temporal correlations on the spatial-temporal graph using local multi-head self-attentions. To reduce the time complexity, we set the attention receptive field to the spatially neighboring nodes, and we also introduce an adaptive graph to capture the hidden spatial-temporal dependencies. Based on these attention mechanisms, we propose a novel Adaptive Graph Spatial-Temporal Transformer Network (ASTTN), which stacks multiple spatial-temporal attention layers to apply self-attention on the input graph, followed by linear layers for predictions. Experimental results on public traffic network datasets, METR-LA PEMS-BAY, PeMSD4, and PeMSD7, demonstrate the superior performance of our model.

📄 PDF Abstract BibTeX arXiv:2207.05064

Code (1)

yokifly/ASTTN_pytorch pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction

2023-10-12 · Xiao Xu, Lei Zhang, Bailong Liu, Zhizhen Liang 외

As a core technology of Intelligent Transportation System (ITS), traffic flow prediction has a wide range of applications. Traffic flow data are spatial-temporal, which are not only correlated to spatial locations in roa…

Incremental LearningKnowledge DistillationPrediction

Dynamic Trend Fusion Module for Traffic Flow Prediction

2025-01-18 · Jing Chen, Haocheng Ye, Zhian Ying, Yuntao Sun 외

Accurate traffic flow prediction is essential for applications like transport logistics but remains challenging due to complex spatio-temporal correlations and non-linear traffic patterns. Existing methods often model sp…

PredictionTraffic Prediction

Hybrid Transformer and Spatial-Temporal Self-Supervised Learning for Long-term Traffic Prediction

2024-01-29 · Wang Zhu, Doudou Zhang, Baichao Long, Jianli Xiao

Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-tem…

Data AugmentationSelf-Supervised LearningTraffic Prediction

Multi-Grained Temporal-Spatial Graph Learning for Stable Traffic Flow Forecasting

2025-07-25 · Zhenan Lin, Yuni Lai, Wai Lun Lo, Richard Tai-Chiu Hsung 외 arxiv

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-sp…

Graph Learning

A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

2024-05-10 · Jianli Xiao, Baichao Long

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction w…

ManagementPrediction