paper-with-me

Papers

HUTFormer: Hierarchical U-Net Transformer for Long-Term Traffic Forecasting

2023-07-27 · Zezhi Shao, Fei Wang, Zhao Zhang, Yuchen Fang, Guangyin Jin, Yongjun Xu

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on Spatial-Temporal Graph Neural Networks (STGNNs) have made significant progress by combining sequential models with graph convolution networks. However, due to high complexity issues, STGNNs only focus on short-term traffic forecasting, e.g., 1-hour forecasting, while ignoring more practical long-term forecasting. In this paper, we make the first attempt to explore long-term traffic forecasting, e.g., 1-day forecasting. To this end, we first reveal its unique challenges in exploiting multi-scale representations. Then, we propose a novel Hierarchical U-net TransFormer (HUTFormer) to address the issues of long-term traffic forecasting. HUTFormer consists of a hierarchical encoder and decoder to jointly generate and utilize multi-scale representations of traffic data. Specifically, for the encoder, we propose window self-attention and segment merging to extract multi-scale representations from long-term traffic data. For the decoder, we design a cross-scale attention mechanism to effectively incorporate multi-scale representations. In addition, HUTFormer employs an efficient input embedding strategy to address the complexity issues. Extensive experiments on four traffic datasets show that the proposed HUTFormer significantly outperforms state-of-the-art traffic forecasting and long time series forecasting baselines.

📄 PDF Abstract BibTeX arXiv:2307.14596

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Focus 설명 없음
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Learning dynamic and hierarchical traffic spatiotemporal features with Transformer

2021-04-12 · Haoyang Yan, Xiaolei Ma

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning method…

TrafFormer: A Transformer Model for Predicting Long-term Traffic

2023-02-24 · David Alexander Tedjopurnomo, Farhana M. Choudhury, A. K. Qin

Traffic prediction is a flourishing research field due to its importance in human mobility in the urban space. Despite this, existing studies only focus on short-term prediction of up to few hours in advance, with most b…

PredictionTraffic Prediction

FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction

2026-04-15 · Xinjin Li, Jinghan Cao, Mengyue Wang, Yue Wu 외 arxiv

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transform…

Traffic Prediction

Spatial-Temporal Transformer Networks for Traffic Flow Forecasting

2020-01-09 · Mingxing Xu, Wenrui Dai, Chunmiao Liu, Xing Gao 외

Traffic forecasting has emerged as a core component of intelligent transportation systems. However, timely accurate traffic forecasting, especially long-term forecasting, still remains an open challenge due to the highly…

Traffic Prediction

LSTTN: A Long-Short Term Transformer-based Spatio-temporal Neural Network for Traffic Flow Forecasting

2024-03-25 · Qinyao Luo, Silu He, Xing Han, YuHan Wang 외

Accurate traffic forecasting is a fundamental problem in intelligent transportation systems and learning long-range traffic representations with key information through spatiotemporal graph neural networks (STGNNs) is a …