Learning a Driving Simulator
Comma.ai's approach to Artificial Intelligence for self-driving cars is based on an agent that learns to clone driver behaviors and plans maneuvers by simulating future events in the road. This paper illustrates one of our research approaches for driving simulation. One where we learn to simulate. Here we investigate variational autoencoders with classical and learned cost functions using generative adversarial networks for embedding road frames. Afterwards, we learn a transition model in the embedded space using action conditioned Recurrent Neural Networks. We show that our approach can keep predicting realistic looking video for several frames despite the transition model being optimized without a cost function in the pixel space.
Code (4)
Tasks
Self-Driving CarsVideo PredictionSimilar Papers 제목 키워드 기반
LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving
Testing autonomous driving algorithms on real autonomous vehicles is extremely costly and many researchers and developers in the field cannot afford a real car and the corresponding sensors. Although several free and ope…
Autonomous DrivingAutonomous VehiclesVocal Bursts Intensity PredictionMRDrive: An Open Source Mixed Reality Driving Simulator for Automotive User Research
Designing and evaluating in-vehicle interfaces requires experimental platforms that combine ecological validity with experimental control. Driving simulators are widely used for this purpose. However, they face a fundame…
DReyeVR: Democratizing Virtual Reality Driving Simulation for Behavioural & Interaction Research
Simulators are an essential tool for behavioural and interaction research on driving, due to the safety, cost, and experimental control issues of on-road driving experiments. The most advanced simulators use expensive 36…
Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving
Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there i…
Autonomous DrivingImproving the Generalization of End-to-End Driving through Procedural Generation
Over the past few years there is a growing interest in the learning-based self driving system. To ensure safety, such systems are first developed and validated in simulators before being deployed in the real world. Howev…
Autonomous Driving