VTGNet: A Vision-based Trajectory Generation Network for Autonomous Vehicles in Urban Environments
Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently, the end-to-end driving method has emerged, which performs well and generalizes to new environments by directly learning from export-provided data. However, many existing methods on this topic neglect to check the confidence of the driving actions and the ability to recover from driving mistakes. In this paper, we develop an uncertainty-aware end-to-end trajectory generation method based on imitation learning. It can extract spatiotemporal features from the front-view camera images for scene understanding, and then generate collision-free trajectories several seconds into the future. The experimental results suggest that under various weather and lighting conditions, our network can reliably generate trajectories in different urban environments, such as turning at intersections and slowing down for collision avoidance. Furthermore, closed-loop driving tests suggest that the proposed method achieves better cross-scene/platform driving results than the state-of-the-art (SOTA) end-to-end control method, where our model can recover from off-center and off-orientation errors and capture 80% of dangerous cases with high uncertainty estimations.
Code (1)
Tasks
Autonomous DrivingAutonomous VehiclesCollision AvoidanceImitation LearningScene UnderstandingSimilar Papers 제목 키워드 기반
Domain Generalization for Vision-based Driving Trajectory Generation
One of the challenges in vision-based driving trajectory generation is dealing with out-of-distribution scenarios. In this paper, we propose a domain generalization method for vision-based driving trajectory generation f…
Autonomous VehiclesDecoderDomain GeneralizationHardware Accelerators in Autonomous Driving
Computing platforms in autonomous vehicles record large amounts of data from many sensors, process the data through machine learning models, and make decisions to ensure the vehicle's safe operation. Fast, accurate, and …
Autonomous DrivingAutonomous VehiclesDecision MakingGraph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving
Forecasting the trajectories of neighbor vehicles is a crucial step for decision making and motion planning of autonomous vehicles. This paper proposes a graph-based spatial-temporal convolutional network (GSTCN) to pred…
Autonomous DrivingAutonomous VehiclesDecision MakingMotion Planning+1Sequential Spatial Network for Collision Avoidance in Autonomous Driving
Several autonomous driving strategies have been applied to autonomous vehicles, especially in the collision avoidance area. The purpose of collision avoidance is achieved by adjusting the trajectory of autonomous vehicle…
Autonomous DrivingAutonomous VehiclesCollision AvoidanceFeature CorrelationAutomatic driving lane change safety prediction model based on LSTM
Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature aut…
Autonomous DrivingAutonomous VehiclesDecision MakingIntent Detection+2