paper-with-me

홈 › Papers

GeoMAE: Masking Representation Learning for Spatio-Temporal Graph Forecasting with Missing Values

2025-08-13 · Songyu Ke, Chenyu Wu, Yuxuan Liang, Huiling Qin, Junbo Zhang, Yu Zheng arxiv

The ubiquity of missing data in urban intelligence systems, attributable to adverse environmental conditions and equipment failures, poses a significant challenge to the efficacy of downstream applications, notably in the realms of traffic forecasting and energy consumption prediction. Therefore, it is imperative to develop a robust spatio-temporal learning methodology capable of extracting meaningful insights from incomplete datasets. Despite the existence of methodologies for spatio-temporal graph forecasting in the presence of missing values, unresolved issues persist. Primarily, the majority of extant research is predicated on time-series analysis, thereby neglecting the dynamic spatial correlations inherent in sensor networks. Additionally, the complexity of missing data patterns compounds the intricacy of the problem. Furthermore, the variability in maintenance conditions results in a significant fluctuation in the ratio and pattern of missing values, thereby challenging the generalizability of predictive models. In response to these challenges, this study introduces GeoMAE, a self-supervised spatio-temporal representation learning model. The model is comprised of three principal components: an input preprocessing module, an attention-based spatio-temporal forecasting network (STAFN), and an auxiliary learning task, which draws inspiration from Masking AutoEncoders to enhance the robustness of spatio-temporal representation learning. Empirical evaluations on real-world datasets demonstrate that GeoMAE significantly outperforms existing benchmarks, achieving up to 13.20\% relative improvement over the best baseline models.

📄 PDF Abstract BibTeX arXiv:2508.14083

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Video Language Model Pretraining with Spatio-temporal Masking

2025-01-01 · CVPR 2025 1 · Yue Wu, Zhaobo Qi, Junshu Sun, YaoWei Wang 외

The development of self-supervised video-language models based on mask learning has significantly advanced downstream video tasks. These models leverage masked reconstruction to facilitate joint learning of visual an…

DecoderLanguage ModelingLanguage ModellingVideo Understanding

Towards Unbiased and Robust Spatio-Temporal Scene Graph Generation and Anticipation

2024-11-20 · CVPR 2025 1 · Rohith Peddi, Saurabh, Ayush Abhay Shrivastava, Parag Singla 외

Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modelling objects and their evolving relationships over time. However, real-world visual relationships often exhib…

Graph GenerationScene Graph GenerationSpatio-temporal Scene GraphsVideo scene graph generation

Self-supervised Action Representation Learning from Partial Spatio-Temporal Skeleton Sequences

2023-02-17 · Yujie Zhou, Haodong Duan, Anyi Rao, Bing Su 외

Self-supervised learning has demonstrated remarkable capability in representation learning for skeleton-based action recognition. Existing methods mainly focus on applying global data augmentation to generate different v…

Action RecognitionContrastive LearningData AugmentationRepresentation Learning+5

Kriformer: A Novel Spatiotemporal Kriging Approach Based on Graph Transformers

2024-09-23 · Renbin Pan, Feng Xiao, Hegui Zhang, Minyu Shen

Accurately estimating data in sensor-less areas is crucial for understanding system dynamics, such as traffic state estimation and environmental monitoring. This study addresses challenges posed by sparse sensor deployme…

Representation LearningState Estimation

ASMa: Asymmetric Spatio-temporal Masking for Skeleton Action Representation Learning

2026-02-05 · Aman Anand, Amir Eskandari, Elyas Rahsno, Farhana Zulkernine arxiv

Self-supervised learning (SSL) has shown remarkable success in skeleton-based action recognition by leveraging data augmentations to learn meaningful representations. However, existing SSL methods rely on data augmentati…

Self-Supervised LearningRepresentation LearningKnowledge DistillationAction Recognition