paper-with-me

Papers

Temporal Graph MLP Mixer for Spatio-Temporal Forecasting

2025-01-17 · Muhammad Bilal, Luis Carretero Lopez

Spatiotemporal forecasting is critical in applications such as traffic prediction, climate modeling, and environmental monitoring. However, the prevalence of missing data in real-world sensor networks significantly complicates this task. In this paper, we introduce the Temporal Graph MLP-Mixer (T-GMM), a novel architecture designed to address these challenges. The model combines node-level processing with patch-level subgraph encoding to capture localized spatial dependencies while leveraging a three-dimensional MLP-Mixer to handle temporal, spatial, and feature-based dependencies. Experiments on the AQI, ENGRAD, PV-US and METR-LA datasets demonstrate the model's ability to effectively forecast even in the presence of significant missing data. While not surpassing state-of-the-art models in all scenarios, the T-GMM exhibits strong learning capabilities, particularly in capturing long-range dependencies. These results highlight its potential for robust, scalable spatiotemporal forecasting.

📄 PDF Abstract BibTeX arXiv:2501.10214

Code (1)

Mu-Bilal/Temporal-Graph-MLP-Mixer 공식 구현 pytorch

Tasks

Spatio-Temporal ForecastingTraffic Prediction

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

FlowMixer: A Constrained Neural Architecture for Interpretable Spatiotemporal Forecasting

2025-05-22 · Fares B. Mehouachi, Saif Eddin Jabari

We introduce FlowMixer, a neural architecture that leverages constrained matrix operations to model structured spatiotemporal patterns. At its core, FlowMixer incorporates non-negative matrix mixing layers within a rever…

Enhancing Topological Dependencies in Spatio-Temporal Graphs with Cycle Message Passing Blocks

2024-01-29 · Minho Lee, Yun Young Choi, Sun Woo Park, Seunghwan Lee 외

Graph Neural Networks (GNNs) and Transformer-based models have been increasingly adopted to learn the complex vector representations of spatio-temporal graphs, capturing intricate spatio-temporal dependencies crucial for…

Spatio-Temporal ForecastingTime Series PredictionTraffic Prediction

HieraMix: A Hierarchical MLP-Mixer for Large-Scale Traffic Forecasting

2025-11-26 · Yongyao Wang, Xie Yu, Jingyuan Wang, Jiahao Ji 외 arxiv

Traffic forecasting task is significant to modern urban management. Recently, there is growing attention on large-scale forecasting, as it better reflects the complexity of real-world traffic networks. However, existing …

Computational Efficiency

STPFormer: A State-of-the-Art Pattern-Aware Spatio-Temporal Transformer for Traffic Forecasting

2025-08-19 · Jiayu Fang, Zhiqi Shao, S T Boris Choy, Junbin Gao arxiv

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often strug…

Representation LearningGraph Matching

PreMixer: MLP-Based Pre-training Enhanced MLP-Mixers for Large-scale Traffic Forecasting

2024-12-18 · Tongtong Zhang, Zhiyong Cui, Bingzhang Wang, Yilong Ren 외

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, …

Computational EfficiencyTime Series