paper-with-me

홈 › Papers

Unveiling the Inflexibility of Adaptive Embedding in Traffic Forecasting

2024-11-18 · Hongjun Wang, Jiyuan Chen, Lingyu Zhang, Renhe Jiang, Xuan Song

Spatiotemporal Graph Neural Networks (ST-GNNs) and Transformers have shown significant promise in traffic forecasting by effectively modeling temporal and spatial correlations. However, rapid urbanization in recent years has led to dynamic shifts in traffic patterns and travel demand, posing major challenges for accurate long-term traffic prediction. The generalization capability of ST-GNNs in extended temporal scenarios and cross-city applications remains largely unexplored. In this study, we evaluate state-of-the-art models on an extended traffic benchmark and observe substantial performance degradation in existing ST-GNNs over time, which we attribute to their limited inductive capabilities. Our analysis reveals that this degradation stems from an inability to adapt to evolving spatial relationships within urban environments. To address this limitation, we reconsider the design of adaptive embeddings and propose a Principal Component Analysis (PCA) embedding approach that enables models to adapt to new scenarios without retraining. We incorporate PCA embeddings into existing ST-GNN and Transformer architectures, achieving marked improvements in performance. Notably, PCA embeddings allow for flexibility in graph structures between training and testing, enabling models trained on one city to perform zero-shot predictions on other cities. This adaptability demonstrates the potential of PCA embeddings in enhancing the robustness and generalization of spatiotemporal models.

📄 PDF Abstract BibTeX arXiv:2411.11448

Code (1)

Dreamzz5/PCA-Embedding 공식 구현 pytorch

Tasks

AttributeTraffic Prediction

Methods 이 논문이 사용한 방법론

Travel 설명 없음
Attention 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

STAEformer: Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecasting

2023-08-21 · Hangchen Liu, Zheng Dong, Renhe Jiang, Jiewen Deng 외

With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patt…

Time SeriesTraffic Prediction

Transfer Learning and Online Learning for Traffic Forecasting under Different Data Availability Conditions: Alternatives and Pitfalls

2020-05-08 · Eric L. Manibardo, Ibai Laña, Javier Del Ser

This work aims at unveiling the potential of Transfer Learning (TL) for developing a traffic flow forecasting model in scenarios of absent data. Knowledge transfer from high-quality predictive models becomes feasible und…

Transfer Learning

Multimodal Spatiotemporal-Frequency Fusion with Peak Enhancement for Cellular Traffic Forecasting

2026-07-08 · Qingzhong Li, Yue Hu, Hui Ma, Yajun Zhang 외 arxiv

Accurate forecasting of cellular network traffic is essential for network planning, resource allocation, and quality-of-service assurance in modern mobile communication systems. Real-world traffic often exhibits bursty e…

Because Every Sensor Is Unique, so Is Every Pair: Handling Dynamicity in Traffic Forecasting

2023-02-20 · Arian Prabowo, Wei Shao, Hao Xue, Piotr Koniusz 외

Traffic forecasting is a critical task to extract values from cyber-physical infrastructures, which is the backbone of smart transportation. However owing to external contexts, the dynamics at each sensor are unique. For…

Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs

2025-03-05 · Haoran Fan, Bin Li, Yixuan Weng, Shoujun Zhou

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typical…

Computational EfficiencyDescriptiveMixture-of-ExpertsTime Series+1