Learning Stability Attention in Vision-based End-to-end Driving Policies
Modern end-to-end learning systems can learn to explicitly infer control from perception. However, it is difficult to guarantee stability and robustness for these systems since they are often exposed to unstructured, high-dimensional, and complex observation spaces (e.g., autonomous driving from a stream of pixel inputs). We propose to leverage control Lyapunov functions (CLFs) to equip end-to-end vision-based policies with stability properties and introduce stability attention in CLFs (att-CLFs) to tackle environmental changes and improve learning flexibility. We also present an uncertainty propagation technique that is tightly integrated into att-CLFs. We demonstrate the effectiveness of att-CLFs via comparison with classical CLFs, model predictive control, and vanilla end-to-end learning in a photo-realistic simulator and on a real full-scale autonomous vehicle.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingModel Predictive ControlSimilar Papers 제목 키워드 기반
Optimizing Low-Speed Autonomous Driving: A Reinforcement Learning Approach to Route Stability and Maximum Speed
Autonomous driving has garnered significant attention in recent years, especially in optimizing vehicle performance under varying conditions. This paper addresses the challenge of maintaining maximum speed stability in l…
Autonomous Drivingreinforcement-learningReinforcement LearningReinforcement Learning (RL)VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Driving
In recent years, reinforcement learning (RL)-based methods for learning driving policies have gained increasing attention in the autonomous driving community and have achieved remarkable progress in various driving scena…
Autonomous DrivingComputational EfficiencyReinforcement Learning (RL)Spatial-aware Vision Language Model for Autonomous Driving
While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding a…
Scene UnderstandingAutonomous DrivingSpatial ReasoningCLEAR: Closed-Loop Reinforcement Learning at Scale for End-to-End Autonomous Driving
End-to-end autonomous driving (E2E-AD) aims to directly map raw sensor information to driving actions. Recently, with the rapid advancement of multi-modal large language models (MLLMs), researchers have proposed the para…
Reinforcement LearningAutonomous DrivingCARLA longest6Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environments
Driving in a complex urban environment is a difficult task that requires a complex decision policy. In order to make informed decisions, one needs to gain an understanding of the long-range context and the importance of …