paper-with-me

Papers

Evaluation of Large Language Models for Decision Making in Autonomous Driving

2023-12-11 · Kotaro Tanahashi, Yuichi Inoue, Yu Yamaguchi, Hidetatsu Yaginuma, Daiki Shiotsuka, Hiroyuki Shimatani, Kohei Iwamasa, Yoshiaki Inoue, Takafumi Yamaguchi, Koki Igari, Tsukasa Horinouchi, Kento Tokuhiro, Yugo Tokuchi, Shunsuke Aoki

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their coordinate and velocity information, and then outputting the subsequent movements of the vehicle. When using LLMs for such purposes, capabilities such as spatial recognition and planning are essential. In particular, two foundational capabilities are required: (1) spatial-aware decision making, which is the ability to recognize space from coordinate information and make decisions to avoid collisions, and (2) the ability to adhere to traffic rules. However, quantitative research has not been conducted on how accurately different types of LLMs can handle these problems. In this study, we quantitatively evaluated these two abilities of LLMs in the context of autonomous driving. Furthermore, to conduct a Proof of Concept (POC) for the feasibility of implementing these abilities in actual vehicles, we developed a system that uses LLMs to drive a vehicle.

📄 PDF Abstract BibTeX arXiv:2312.06351

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecision Making

Similar Papers 제목 키워드 기반

Large Language Model based Interactive Decision-Making for Autonomous Driving

2026-04-26 · Xinwei Dong, Jiyang Li, Jiabin Xie, Yang Yi 외 arxiv

In high-conflict mixed-traffic scenarios involving human-driven and autonomous vehicles, most existing autonomous driving systems default to overly conservative behaviors, lack proactive interaction, and consequently suf…

Scene UnderstandingAutonomous VehiclesAutonomous DrivingDecision Making

RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Driving

2025-03-18 · Yujin Wang, Quanfeng Liu, Zhengxin Jiang, Tianyi Wang 외

Accurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems. While vision-language models (VLMs) have shown significant potential in various autono…

Autonomous DrivingDecision MakingHallucinationImage Comprehension+3

Large Language Models for Explainable Decisions in Dynamic Digital Twins

2024-05-23 · Nan Zhang, Christian Vergara-Marcillo, Georgios Diamantopoulos, Jingran Shen 외

Dynamic data-driven Digital Twins (DDTs) can enable informed decision-making and provide an optimisation platform for the underlying system. By leveraging principles of Dynamic Data-Driven Applications Systems (DDDAS), D…

Decision Making

SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Models

2024-12-17 · Zhiyuan Zhou, Heye Huang, Boqi Li, Shiyue Zhao 외

Recent advancements in autonomous vehicles (AVs) use Large Language Models (LLMs) to perform well in normal driving scenarios. However, ensuring safety in dynamic, high-risk environments and managing safety-critical long…

Autonomous DrivingAutonomous VehiclesDecision Making

GPT-4V Explorations: Mining Autonomous Driving

2024-06-24 · Zixuan Li

This paper explores the application of the GPT-4V(ision) large visual language model to autonomous driving in mining environments, where traditional systems often falter in understanding intentions and making accurate de…

Autonomous DrivingDecision MakingLanguage ModelingLanguage Modelling+3