paper-with-me

홈 › Papers

Asynchronous Large Language Model Enhanced Planner for Autonomous Driving

2024-06-20 · Yuan Chen, Zi-han Ding, Ziqin Wang, Yan Wang, Lijun Zhang, Si Liu

Despite real-time planners exhibiting remarkable performance in autonomous driving, the growing exploration of Large Language Models (LLMs) has opened avenues for enhancing the interpretability and controllability of motion planning. Nevertheless, LLM-based planners continue to encounter significant challenges, including elevated resource consumption and extended inference times, which pose substantial obstacles to practical deployment. In light of these challenges, we introduce AsyncDriver, a new asynchronous LLM-enhanced closed-loop framework designed to leverage scene-associated instruction features produced by LLM to guide real-time planners in making precise and controllable trajectory predictions. On one hand, our method highlights the prowess of LLMs in comprehending and reasoning with vectorized scene data and a series of routing instructions, demonstrating its effective assistance to real-time planners. On the other hand, the proposed framework decouples the inference processes of the LLM and real-time planners. By capitalizing on the asynchronous nature of their inference frequencies, our approach have successfully reduced the computational cost introduced by LLM, while maintaining comparable performance. Experiments show that our approach achieves superior closed-loop evaluation performance on nuPlan's challenging scenarios.

📄 PDF Abstract BibTeX arXiv:2406.14556

Code (1)

memberre/asyncdriver 공식 구현

Tasks

Autonomous DrivingLanguage ModelingLanguage ModellingLarge Language ModelMotion Planning

Similar Papers 제목 키워드 기반

FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation

2025-05-27 · Jiaping Xiao, Cheng Wen Tsao, Yuhang Zhang, Mir Feroskhan

Path planning is a critical component in autonomous drone operations, enabling safe and efficient navigation through complex environments. Recent advances in foundation models, particularly large language models (LLMs) a…

BenchmarkingDecision MakingDrone navigation

Autonomous 3D Exploration in Large-Scale Environments with Dynamic Obstacles

2023-10-27 · Emil Wiman, Ludvig Widén, Mattias Tiger, Fredrik Heintz

Exploration in dynamic and uncertain real-world environments is an open problem in robotics and constitutes a foundational capability of autonomous systems operating in most of the real world. While 3D exploration planni…

Collision Avoidance

LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning

2025-12-20 · Yudong Liu, Spencer Hallyburton, Jiwoo Kim, Yueqian Lin 외 arxiv

Trajectory planning is a fundamental yet challenging component of autonomous driving. End-to-end planners frequently falter under adverse weather, unpredictable human behavior, or complex road layouts, primarily because …

Scene UnderstandingTrajectory PlanningAutonomous Driving

PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving

2026-09-08 · Yuan Gao, Sebastian Müller, Mattia Piccinini, Marc Kaufeld 외 hf

Ensuring the safety of autonomous driving is a critical challenge. Scenario-based testing is a systematic process used to validate Autonomous Driving Systems (ADSs), but it remains a fragmented modular pipeline in which …

Autonomous Driving

Large Language Model Enhanced Differentiable Trajectory Planning for IoT-Enabled Autonomous Driving

2026-07-11 · Shihao Zhang, Jing Yang, Ziyu Song, Zheng Lin 외 arxiv

Autonomous driving planning is a key component of IoT-enabled intelligent transportation systems, requiring vehicles to generate safe, efficient, and executable trajectories in complex urban environments from multi-sourc…

Trajectory PlanningAutonomous DrivingData Augmentation