paper-with-me

홈 › Papers

Robustness of LLM-enabled vehicle trajectory prediction under data security threats

2025-11-14 · Feilong Wang, Fuqiang Liu arxiv

The integration of large language models (LLMs) into automated driving systems has opened new possibilities for reasoning and decision-making by transforming complex driving contexts into language-understandable representations. Recent studies demonstrate that fine-tuned LLMs can accurately predict vehicle trajectories and lane-change intentions by gathering and transforming data from surrounding vehicles. However, the robustness of such LLM-based prediction models for safety-critical driving systems remains unexplored, despite the increasing concerns about the trustworthiness of LLMs. This study addresses this gap by conducting a systematic vulnerability analysis of LLM-enabled vehicle trajectory prediction. We propose a one-feature differential evolution attack that perturbs a single kinematic feature of surrounding vehicles within the LLM's input prompts under a black-box setting. Experiments on the highD dataset reveal that even minor, physically plausible perturbations can significantly disrupt model outputs, underscoring the susceptibility of LLM-based predictors to adversarial manipulation. Further analyses reveal a trade-off between accuracy and robustness, examine the failure mechanism, and explore potential mitigation solutions. The findings provide the very first insights into adversarial vulnerabilities of LLM-driven automated vehicle models in the context of vehicular interactions and highlight the need for robustness-oriented design in future LLM-based intelligent transportation systems.

📄 PDF Abstract BibTeX arXiv:2511.13753

Code (0)

등록된 구현이 없습니다.

Tasks

Trajectory Prediction

Similar Papers 제목 키워드 기반

On Adversarial Robustness of Trajectory Prediction for Autonomous Vehicles

2022-01-13 · CVPR 2022 1 · Qingzhao Zhang, Shengtuo Hu, Jiachen Sun, Qi Alfred Chen 외

Trajectory prediction is a critical component for autonomous vehicles (AVs) to perform safe planning and navigation. However, few studies have analyzed the adversarial robustness of trajectory prediction or investigated …

Adversarial AttackAdversarial RobustnessAutonomous VehiclesData Augmentation+2

Deep Learning based Urban Vehicle Trajectory Analytics

2021-11-15 · Seongjin Choi

A `trajectory' refers to a trace generated by a moving object in geographical spaces, usually represented by of a series of chronologically ordered points, where each point consists of a geo-spatial coordinate set and a …

Deep Learning

Historical Prediction Attention Mechanism based Trajectory Forecasting for Proactive Work Zone Safety in a Digital Twin Environment

2025-08-05 · Minhaj Uddin Ahmad, Mizanur Rahman, Alican Sevim, David Bodoh 외 arxiv

Proactive safety systems aim to mitigate risks by anticipating potential conflicts between vehicles and enabling early intervention to prevent work zone-related crashes. This study presents an infrastructure-enabled proa…

Trajectory ForecastingTrajectory Prediction

Multi-Vehicle Trajectory Prediction at Intersections using State and Intention Information

2023-01-06 · Dekai Zhu, Qadeer Khan, Daniel Cremers

Traditional approaches to prediction of future trajectory of road agents rely on knowing information about their past trajectory. This work rather relies only on having knowledge of the current state and intended directi…

PredictionTrajectory Prediction

MapsTP: HD Map Images Based Multimodal Trajectory Prediction for Automated Vehicles

2024-07-08 · Sushil Sharma, Arindam Das, Ganesh Sistu, Mark Halton 외

Predicting ego vehicle trajectories remains a critical challenge, especially in urban and dense areas due to the unpredictable behaviours of other vehicles and pedestrians. Multimodal trajectory prediction enhances decis…

Autonomous VehiclesDecision MakingTrajectory Prediction