Autonomous Driving in Reality with Reinforcement Learning and Image Translation
Supervised learning is widely used in training autonomous driving vehicle. However, it is trained with large amount of supervised labeled data. Reinforcement learning can be trained without abundant labeled data, but we cannot train it in reality because it would involve many unpredictable accidents. Nevertheless, training an agent with good performance in virtual environment is relatively much easier. Because of the huge difference between virtual and real, how to fill the gap between virtual and real is challenging. In this paper, we proposed a novel framework of reinforcement learning with image semantic segmentation network to make the whole model adaptable to reality. The agent is trained in TORCS, a car racing simulator.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingCar Racingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Semantic SegmentationTranslationSimilar Papers 제목 키워드 기반
Multi-Vehicle Mixed-Reality Reinforcement Learning for Autonomous Multi-Lane Driving
Autonomous driving promises to transform road transport. Multi-vehicle and multi-lane scenarios, however, present unique challenges due to constrained navigation and unpredictable vehicle interactions. Learning-based met…
Autonomous DrivingAutonomous VehiclesDeep Reinforcement LearningMixed Reality+3Virtual to Real Reinforcement Learning for Autonomous Driving
Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-er…
Autonomous DrivingDomain AdaptationImage-to-Image Translationreinforcement-learning+5Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data
Autonomous driving is complex, requiring sophisticated 3D scene understanding, localization, mapping, and control. Rather than explicitly modelling and fusing each of these components, we instead consider an end-to-end a…
Autonomous DrivingGPUReinforcement Learning (RL)Robot Manipulation+1How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligence
Safety and cost are two important concerns for the development of autonomous driving technologies. From the academic research to commercial applications of autonomous driving vehicles, sufficient simulation and real worl…
Autonomous DrivingReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene Reconstruction
Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, cre…
Reinforcement LearningAutonomous Driving