XLM for Autonomous Driving Systems: A Comprehensive Review
Large Language Models (LLMs) have showcased remarkable proficiency in various information-processing tasks. These tasks span from extracting data and summarizing literature to generating content, predictive modeling, decision-making, and system controls. Moreover, Vision Large Models (VLMs) and Multimodal LLMs (MLLMs), which represent the next generation of language models, a.k.a., XLMs, can combine and integrate many data modalities with the strength of language understanding, thus advancing several information-based systems, such as Autonomous Driving Systems (ADS). Indeed, by combining language communication with multimodal sensory inputs, e.g., panoramic images and LiDAR or radar data, accurate driving actions can be taken. In this context, we provide in this survey paper a comprehensive overview of the potential of XLMs towards achieving autonomous driving. Specifically, we review the relevant literature on ADS and XLMs, including their architectures, tools, and frameworks. Then, we detail the proposed approaches to deploy XLMs for autonomous driving solutions. Finally, we provide the related challenges to XLM deployment for ADS and point to future research directions aiming to enable XLM adoption in future ADS frameworks.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDecision MakingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Survey of End-to-End Driving: Architectures and Training Methods
Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take …
Autonomous DrivingThe Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey
Driving World Model (DWM), which focuses on predicting scene evolution during the driving process, has emerged as a promising paradigm in pursuing autonomous driving. These methods enable autonomous driving systems to be…
Autonomous DrivingSurveyExplainability of deep vision-based autonomous driving systems: Review and challenges
This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a saf…
Autonomous DrivingExplainable artificial intelligenceSurveyA Comprehensive Review of 3D Object Detection in Autonomous Driving: Technological Advances and Future Directions
In recent years, 3D object perception has become a crucial component in the development of autonomous driving systems, providing essential environmental awareness. However, as perception tasks in autonomous driving evolv…
3D Object DetectionAutonomous DrivingObjectobject-detection+1Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review
With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped s…
Autonomous DrivingRetrieval