DriveCode: Domain Specific Numerical Encoding for LLM-Based Autonomous Driving
Large language models (LLMs) have shown great promise for autonomous driving. However, discretizing numbers into tokens limits precise numerical reasoning, fails to reflect the positional significance of digits in the training objective, and makes it difficult to achieve both decoding efficiency and numerical precision. These limitations affect both the processing of sensor measurements and the generation of precise control commands, creating a fundamental barrier for deploying LLM-based autonomous driving systems. In this paper, we introduce DriveCode, a novel numerical encoding method that represents numbers as dedicated embeddings rather than discrete text tokens. DriveCode employs a number projector to map numbers into the language model's hidden space, enabling seamless integration with visual and textual features in a unified multimodal sequence. Evaluated on OmniDrive, DriveGPT4, and DriveGPT4-V2 datasets, DriveCode demonstrates superior performance in trajectory prediction and control signal generation, confirming its effectiveness for LLM-based autonomous driving systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Trajectory PredictionAutonomous DrivingSimilar Papers 제목 키워드 기반
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding
Recent progress in Large Language Models (LLMs) has opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS). However, existing LLM-driven NAS approaches rely heavily on pr…
Neural Architecture SearchImage ClassificationPrompt EngineeringTrace Encoding in Process Mining: a survey and benchmarking
Encoding methods are employed across several process mining tasks, including predictive process monitoring, anomalous case detection, trace clustering, etc. These methods are usually performed as preprocessing steps and …
BenchmarkingPredictive Process MonitoringSurveyA Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Prediction
Accurate prediction of future trajectories for surrounding vehicles is vital for the safe operation of autonomous vehicles. This study proposes a Lane Graph Transformer (LGT) model with structure-aware capabilities. Its …
Autonomous VehiclesTrajectory PredictionFrom Uniform to Learned Knots: A Study of Spline-Based Numerical Encodings for Tabular Deep Learning
Numerical preprocessing remains a critical component of tabular deep learning, as the representation of continuous features can strongly affect downstream performance. We systematically study spline-based numerical encod…
Knowledge Graph Reasoning over Entities and Numerical Values
A complex logic query in a knowledge graph refers to a query expressed in logic form that conveys a complex meaning, such as where did the Canadian Turing award winner graduate from? Knowledge graph reasoning-based appli…
AttributeComplex Query AnsweringKnowledge Graphs