paper-with-me

Papers

UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction

2024-02-19 · Yuan Yuan, Jingtao Ding, Jie Feng, Depeng Jin, Yong Li

Urban spatio-temporal prediction is crucial for informed decision-making, such as traffic management, resource optimization, and emergence response. Despite remarkable breakthroughs in pretrained natural language models that enable one model to handle diverse tasks, a universal solution for spatio-temporal prediction remains challenging Existing prediction approaches are typically tailored for specific spatio-temporal scenarios, requiring task-specific model designs and extensive domain-specific training data. In this study, we introduce UniST, a universal model designed for general urban spatio-temporal prediction across a wide range of scenarios. Inspired by large language models, UniST achieves success through: (i) utilizing diverse spatio-temporal data from different scenarios, (ii) effective pre-training to capture complex spatio-temporal dynamics, (iii) knowledge-guided prompts to enhance generalization capabilities. These designs together unlock the potential of building a universal model for various scenarios Extensive experiments on more than 20 spatio-temporal scenarios demonstrate UniST's efficacy in advancing state-of-the-art performance, especially in few-shot and zero-shot prediction. The datasets and code implementation are released on https://github.com/tsinghua-fib-lab/UniST.

📄 PDF Abstract BibTeX arXiv:2402.11838

Code (1)

tsinghua-fib-lab/unist 공식 구현 pytorch

Tasks

Decision MakingManagementPrediction

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

UrbanDiT: A Foundation Model for Open-World Urban Spatio-Temporal Learning

2024-11-19 · Yuan Yuan, Chonghua Han, Jingtao Ding, Depeng Jin 외

The urban environment is characterized by complex spatio-temporal dynamics arising from diverse human activities and interactions. Effectively modeling these dynamics is essential for understanding and optimizing urban s…

ImputationMulti-Task LearningPrompt Learning

FlashST: A Simple and Universal Prompt-Tuning Framework for Traffic Prediction

2024-05-28 · Zhonghang Li, Lianghao Xia, Yong Xu, Chao Huang

The objective of traffic prediction is to accurately forecast and analyze the dynamics of transportation patterns, considering both space and time. However, the presence of distribution shift poses a significant challeng…

In-Context LearningPredictionSpatio-Temporal ForecastingTraffic Prediction+1

UniST-Pred: A Robust Unified Framework for Spatio-Temporal Traffic Forecasting in Transportation Networks Under Disruptions

2026-02-15 · Yue Wang, Areg Karapetyan, Djellel Difallah, Samer Madanat arxiv

Spatio-temporal traffic forecasting is a core component of intelligent transportation systems, supporting various downstream tasks such as signal control and network-level traffic management. In real-world deployments, f…

Representation LearningTraffic Prediction

PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction

2023-09-18 · Zijian Zhang, Xiangyu Zhao, Qidong Liu, Chunxu Zhang 외

In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, p…

AttributePrediction

UniSTD: Towards Unified Spatio-Temporal Learning across Diverse Disciplines

2025-03-26 · CVPR 2025 1 · Chen Tang, Xinzhu Ma, Encheng Su, Xiufeng Song 외

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we intro…