paper-with-me

Papers

PKRD-CoT: A Unified Chain-of-thought Prompting for Multi-Modal Large Language Models in Autonomous Driving

2024-12-02 · Xuewen Luo, Fan Ding, Yinsheng Song, Xiaofeng Zhang, Junnyong Loo

There is growing interest in leveraging the capabilities of robust Multi-Modal Large Language Models (MLLMs) directly within autonomous driving contexts. However, the high costs and complexity of designing and training end-to-end autonomous driving models make them challenging for many enterprises and research entities. To address this, our study explores a seamless integration of MLLMs into autonomous driving systems by proposing a Zero-Shot Chain-of-Thought (Zero-Shot-CoT) prompt design named PKRD-CoT. PKRD-CoT is based on the four fundamental capabilities of autonomous driving: perception, knowledge, reasoning, and decision-making. This makes it particularly suitable for understanding and responding to dynamic driving environments by mimicking human thought processes step by step, thus enhancing decision-making in real-time scenarios. Our design enables MLLMs to tackle problems without prior experience, thereby increasing their utility within unstructured autonomous driving environments. In experiments, we demonstrate the exceptional performance of GPT-4.0 with PKRD-CoT across autonomous driving tasks, highlighting its effectiveness in autonomous driving scenarios. Additionally, our benchmark analysis reveals the promising viability of PKRD-CoT for other MLLMs, such as Claude, LLava1.6, and Qwen-VL-Plus. Overall, this study contributes a novel and unified prompt-design framework for GPT-4.0 and other MLLMs in autonomous driving, while also rigorously evaluating the efficacy of these widely recognized MLLMs in the autonomous driving domain through comprehensive comparisons.

📄 PDF Abstract BibTeX arXiv:2412.02025

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecision Making

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

2022-01-28 · Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 외

We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reason…

Common Sense ReasoningGSM8KLanguage ModelingLanguage Modelling+2

Rationale-Augmented Ensembles in Language Models

2022-07-02 · Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le 외

Recent research has shown that rationales, or step-by-step chains of thought, can be used to improve performance in multi-step reasoning tasks. We reconsider rationale-augmented prompting for few-shot in-context learning…

In-Context LearningPrompt EngineeringQuestion AnsweringSentiment Analysis+1

Self-Consistency Improves Chain of Thought Reasoning in Language Models

2022-03-21 · Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le 외

Chain-of-thought prompting combined with pre-trained large language models has achieved encouraging results on complex reasoning tasks. In this paper, we propose a new decoding strategy, self-consistency, to replace the …

ARCArithmetic ReasoningGSM8KLanguage Modelling+2

Chain-of-Thought Augmentation with Logit Contrast for Enhanced Reasoning in Language Models

2024-07-04 · Jay Shim, Grant Kruttschnitt, Alyssa Ma, Daniel Kim 외

Rapidly increasing model scales coupled with steering methods such as chain-of-thought prompting have led to drastic improvements in language model reasoning. At the same time, models struggle with compositional generali…

Language ModelingLanguage Modelling

Contrastive Chain-of-Thought Prompting

2023-11-15 · Yew Ken Chia, Guizhen Chen, Luu Anh Tuan, Soujanya Poria 외

Despite the success of chain of thought in enhancing language model reasoning, the underlying process remains less well understood. Although logically sound reasoning appears inherently crucial for chain of thought, prio…

Language ModelingLanguage Modellingvalid