paper-with-me

홈 › Papers

A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Data

2024-04-23 · Hao Miao, Yan Zhao, Chenjuan Guo, Bin Yang, Kai Zheng, Feiteng Huang, Jiandong Xie, Christian S. Jensen

The widespread deployment of wireless and mobile devices results in a proliferation of spatio-temporal data that is used in applications, e.g., traffic prediction, human mobility mining, and air quality prediction, where spatio-temporal prediction is often essential to enable safety, predictability, or reliability. Many recent proposals that target deep learning for spatio-temporal prediction suffer from so-called catastrophic forgetting, where previously learned knowledge is entirely forgotten when new data arrives. Such proposals may experience deteriorating prediction performance when applied in settings where data streams into the system. To enable spatio-temporal prediction on streaming data, we propose a unified replay-based continuous learning framework. The framework includes a replay buffer of previously learned samples that are fused with training data using a spatio-temporal mixup mechanism in order to preserve historical knowledge effectively, thus avoiding catastrophic forgetting. To enable holistic representation preservation, the framework also integrates a general spatio-temporal autoencoder with a carefully designed spatio-temporal simple siamese (STSimSiam) network that aims to ensure prediction accuracy and avoid holistic feature loss by means of mutual information maximization. The framework further encompasses five spatio-temporal data augmentation methods to enhance the performance of STSimSiam. Extensive experiments on real data offer insight into the effectiveness of the proposed framework.

📄 PDF Abstract BibTeX arXiv:2404.14999

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationPredictionTraffic Prediction

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

UniSTD: Towards Unified Spatio-Temporal Learning across Diverse Disciplines

2025-03-26 · CVPR 2025 1 · Chen Tang, Xinzhu Ma, Encheng Su, Xiufeng Song 외

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we intro…

USTM: Unified Spatial and Temporal Modeling for Continuous Sign Language Recognition

2025-12-15 · Ahmed Abul Hasanaath, Hamzah Luqman arxiv

Continuous sign language recognition (CSLR) requires precise spatio-temporal modeling to accurately recognize sequences of gestures in videos. Existing frameworks often rely on CNN-based spatial backbones combined with t…

Sign Language Recognition

UniTS: Unified Spatio-Temporal Generative Model for Remote Sensing

2025-12-04 · Yuxiang Zhang, Shunlin Liang, Wenyuan Li, Han Ma 외 arxiv

One of the primary objectives of satellite remote sensing is to capture the complex dynamics of the Earth environment, which encompasses tasks such as reconstructing continuous cloud-free image sequences, detecting land …

Time Series ForecastingChange DetectionCloud Removal

VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioning

2025-10-09 · Minghong Cai, Qiulin Wang, Zongli Ye, Wenze Liu 외 arxiv

Existing controllable video generation methods are typically designed for rigid, task-specific settings, such as first-frame image-to-video, inpainting, or interpolation, treating spatio-temporal control as a set of isol…

Video Generation

STARK: Spatio-Temporal Attention for Representation of Keypoints for Continuous Sign Language Recognition

2026-03-17 · Suvajit Patra, Soumitra Samanta arxiv

Continuous Sign Language Recognition (CSLR) is a crucial task for understanding the languages of deaf communities. Contemporary keypoint-based approaches typically rely on spatio-temporal encoding, where spatial interact…

Sign Language Recognition