TrafFormer: A Transformer Model for Predicting Long-term Traffic

2023-02-24 · David Alexander Tedjopurnomo, Farhana M. Choudhury, A. K. Qin

Traffic prediction is a flourishing research field due to its importance in human mobility in the urban space. Despite this, existing studies only focus on short-term prediction of up to few hours in advance, with most being up to one hour only. Long-term traffic prediction can enable more comprehensive, informed, and proactive measures against traffic congestion and is therefore an important task to explore. In this paper, we explore the task of long-term traffic prediction; where we predict traffic up to 24 hours in advance. We note the weaknesses of existing models--which are based on recurrent structures--for long-term traffic prediction and propose a modified Transformer model "TrafFormer". Experiments comparing our model with existing hybrid neural network models show the superiority of our model.

📄 PDF Abstract BibTeX arXiv:2302.12388

Code (1)

david-tedjopurnomo/trafformer 공식 구현 tf

Tasks

Prediction Traffic Prediction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Adam 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

DETNO: A Diffusion-Enhanced Transformer Neural Operator for Long-Term Traffic Forecasting

2025-08-26 · Owais Ahmad, Milad Ramezankhani, Anirudh Deodhar arxiv

Accurate long-term traffic forecasting remains a critical challenge in intelligent transportation systems, particularly when predicting high-frequency traffic phenomena such as shock waves and congestion boundaries over …

TransGaze-Object: Transformer Based Driver Gaze Object Prediction Framework in Real Driving

2026-09-09 · Pavan Kumar Sharma, Ayush Pande, Pranamesh Chakraborty arxiv

Driver gaze provides information regarding driver visual attention and situational awareness to the surrounding traffic. Existing driver gaze estimation studies represent gaze in terms of gaze zone or gaze vector/point-o…

Gaze Estimation

Spatial-Temporal Transformer Networks for Traffic Flow Forecasting

2020-01-09 · Mingxing Xu, Wenrui Dai, Chunmiao Liu, Xing Gao 외

Traffic forecasting has emerged as a core component of intelligent transportation systems. However, timely accurate traffic forecasting, especially long-term forecasting, still remains an open challenge due to the highly…

Traffic Prediction

LSTTN: A Long-Short Term Transformer-based Spatio-temporal Neural Network for Traffic Flow Forecasting

2024-03-25 · Qinyao Luo, Silu He, Xing Han, YuHan Wang 외

Accurate traffic forecasting is a fundamental problem in intelligent transportation systems and learning long-range traffic representations with key information through spatiotemporal graph neural networks (STGNNs) is a …

HUTFormer: Hierarchical U-Net Transformer for Long-Term Traffic Forecasting

2023-07-27 · Zezhi Shao, Fei Wang, Zhao Zhang, Yuchen Fang 외

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent…

Decoder Time Series Time Series Forecasting