Enhanced Safety in Autonomous Driving: Integrating Latent State Diffusion Model for End-to-End Navigation
With the advancement of autonomous driving, ensuring safety during motion planning and navigation is becoming more and more important. However, most end-to-end planning methods suffer from a lack of safety. This research addresses the safety issue in the control optimization problem of autonomous driving, formulated as Constrained Markov Decision Processes (CMDPs). We propose a novel, model-based approach for policy optimization, utilizing a conditional Value-at-Risk based Soft Actor Critic to manage constraints in complex, high-dimensional state spaces effectively. Our method introduces a worst-case actor to guide safe exploration, ensuring rigorous adherence to safety requirements even in unpredictable scenarios. The policy optimization employs the Augmented Lagrangian method and leverages latent diffusion models to predict and simulate future trajectories. This dual approach not only aids in navigating environments safely but also refines the policy's performance by integrating distribution modeling to account for environmental uncertainties. Empirical evaluations conducted in both simulated and real environment demonstrate that our approach outperforms existing methods in terms of safety, efficiency, and decision-making capabilities.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDecision MakingMotion PlanningSafe ExplorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Integrating Object Detection Modality into Visual Language Model for Enhanced Autonomous Driving Agent
In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object det…
Autonomous DrivingLanguage ModelingLanguage Modellingobject-detection+3Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving
Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy opti…
Reinforcement LearningAutonomous DrivingEfficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrations
An intelligent driving system should dynamically formulate appropriate driving strategies based on the current environment and vehicle status while ensuring system security and reliability. However, methods based on rein…
Autonomous DrivingDeep Reinforcement LearningImitation Learningreinforcement-learning+1SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Models
Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLL…
AttributeAutonomous DrivingRAGRetrieval-augmented GenerationEvaluation of Safety Cognition Capability in Vision-Language Models for Autonomous Driving
Assessing the safety of vision-language models (VLMs) in autonomous driving is particularly important; however, existing work mainly focuses on traditional benchmark evaluations. As interactive components within autonomo…
Autonomous Drivingtext annotation