Enhancing Traffic Prediction with Textual Data Using Large Language Models
Traffic prediction is pivotal for rational transportation supply scheduling and allocation. Existing researches into short-term traffic prediction, however, face challenges in adequately addressing exceptional circumstances and integrating non-numerical contextual information like weather into models. While, Large language models offer a promising solution due to their inherent world knowledge. However, directly using them for traffic prediction presents drawbacks such as high cost, lack of determinism, and limited mathematical capability. To mitigate these issues, this study proposes a novel approach. Instead of directly employing large models for prediction, it utilizes them to process textual information and obtain embeddings. These embeddings are then combined with historical traffic data and inputted into traditional spatiotemporal forecasting models. The study investigates two types of special scenarios: regional-level and node-level. For regional-level scenarios, textual information is represented as a node connected to the entire network. For node-level scenarios, embeddings from the large model represent additional nodes connected only to corresponding nodes. This approach shows a significant improvement in prediction accuracy according to our experiment of New York Bike dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionSchedulingTraffic PredictionWorld KnowledgeSimilar Papers 제목 키워드 기반
A Knowledge-Guided Cross-Modal Feature Fusion Model for Local Traffic Demand Prediction
Traffic demand prediction plays a critical role in intelligent transportation systems. Existing traffic prediction models primarily rely on temporal traffic data, with limited efforts incorporating human knowledge and ex…
Representation LearningTraffic PredictionCounterfactual Explanations for Deep Learning-Based Traffic Forecasting
Deep learning models are widely used in traffic forecasting and have achieved state-of-the-art prediction accuracy. However, the black-box nature of those models makes the results difficult to interpret by users. This st…
counterfactualDeep LearningLarge Language Models Powered Context-aware Motion Prediction in Autonomous Driving
Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, l…
Autonomous DrivingMotion Forecastingmotion predictionPrediction+1Cross-domain Few-shot In-context Learning for Enhancing Traffic Sign Recognition
Recent multimodal large language models (MLLM) such as GPT-4o and GPT-4v have shown great potential in autonomous driving. In this paper, we propose a cross-domain few-shot in-context learning method based on the MLLM fo…
Autonomous DrivingCross-Domain Few-ShotIn-Context LearningTraffic Sign Detection+1CrossTrafficLLM: A Human-Centric Framework for Interpretable Traffic Intelligence via Large Language Model
While accurate traffic forecasting is vital for Intelligent Transportation Systems (ITS), effectively communicating predicted conditions via natural language for human-centric decision support remains a challenge and is …
Text Generation