paper-with-me

홈 › Papers

XLM for Autonomous Driving Systems: A Comprehensive Review

2024-09-16 · Sonda Fourati, Wael Jaafar, Noura Baccar, Safwan Alfattani

Large Language Models (LLMs) have showcased remarkable proficiency in various information-processing tasks. These tasks span from extracting data and summarizing literature to generating content, predictive modeling, decision-making, and system controls. Moreover, Vision Large Models (VLMs) and Multimodal LLMs (MLLMs), which represent the next generation of language models, a.k.a., XLMs, can combine and integrate many data modalities with the strength of language understanding, thus advancing several information-based systems, such as Autonomous Driving Systems (ADS). Indeed, by combining language communication with multimodal sensory inputs, e.g., panoramic images and LiDAR or radar data, accurate driving actions can be taken. In this context, we provide in this survey paper a comprehensive overview of the potential of XLMs towards achieving autonomous driving. Specifically, we review the relevant literature on ADS and XLMs, including their architectures, tools, and frameworks. Then, we detail the proposed approaches to deploy XLMs for autonomous driving solutions. Finally, we provide the related challenges to XLM deployment for ADS and point to future research directions aiming to enable XLM adoption in future ADS frameworks.

📄 PDF Abstract BibTeX arXiv:2409.10484

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecision Making

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

A Survey of End-to-End Driving: Architectures and Training Methods

2020-03-13 · Ardi Tampuu, Maksym Semikin, Naveed Muhammad, Dmytro Fishman 외

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take …

Autonomous Driving

The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey

2025-02-14 · Sifan Tu, Xin Zhou, Dingkang Liang, Xingyu Jiang 외

Driving World Model (DWM), which focuses on predicting scene evolution during the driving process, has emerged as a promising paradigm in pursuing autonomous driving. These methods enable autonomous driving systems to be…

Autonomous DrivingSurvey

Explainability of deep vision-based autonomous driving systems: Review and challenges

2021-01-13 · Éloi Zablocki, Hédi Ben-Younes, Patrick Pérez, Matthieu Cord

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a saf…

Autonomous DrivingExplainable artificial intelligenceSurvey

A Comprehensive Review of 3D Object Detection in Autonomous Driving: Technological Advances and Future Directions

2024-08-28 · Yu Wang, Shaohua Wang, Yicheng Li, Mingchun Liu

In recent years, 3D object perception has become a crucial component in the development of autonomous driving systems, providing essential environmental awareness. However, as perception tasks in autonomous driving evolv…

3D Object DetectionAutonomous DrivingObjectobject-detection+1

Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review

2023-12-08 · Shanliang Yao, Runwei Guan, Zitian Peng, Chenhang Xu 외

With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped s…

Autonomous DrivingRetrieval