LiDAR Sensor modeling and Data augmentation with GANs for Autonomous driving
In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and model in closed forms. Instead, sensors models can be learned from real data. The main challenge is the absence of paired data set, which makes traditional supervised learning techniques not suitable. In this work, we formulate the problem as image translation from unpaired data and employ CycleGANs to solve the sensor modeling problem for LiDAR, to produce realistic LiDAR from simulated LiDAR (sim2real). Further, we generate high-resolution, realistic LiDAR from lower resolution one (real2real). The LiDAR 3D point cloud is processed in Bird-eye View and Polar 2D representations. The experimental results show a high potential of the proposed approach.
Code (1)
Tasks
Autonomous DrivingData AugmentationImage-to-Image TranslationPoint Cloud GenerationSensor ModelingTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
Unsupervised Neural Sensor Models for Synthetic LiDAR Data Augmentation
Data scarcity is a bottleneck to machine learning-based perception modules, usually tackled by augmenting real data with synthetic data from simulators. Realistic models of the vehicle perception sensors are hard to form…
Data Augmentationobject-detectionObject DetectionStyle TransferInstant Domain Augmentation for LiDAR Semantic Segmentation
Despite the increasing popularity of LiDAR sensors, perception algorithms using 3D LiDAR data struggle with the 'sensor-bias problem'. Specifically, the performance of perception algorithms significantly drops when an un…
Domain AdaptationLIDAR Semantic SegmentationSemantic SegmentationFrom One to the Power of Many: Invariance to Multi-LiDAR Perception from Single-Sensor Datasets
Recently, LiDAR segmentation methods for autonomous vehicles, powered by deep neural networks, have experienced steep growth in performance on classic benchmarks, such as nuScenes and SemanticKITTI. However, there are st…
Autonomous VehiclesDomain GeneralizationNeural Radiance Field with LiDAR maps
We address outdoor Neural Radiance Fields (NeRF) with LiDAR maps. Existing NeRF methods usually require specially collected hypersampled source views and do not perform well with the open source camera-LiDAR datasets…
3D geometryData AugmentationNeRFGAN-Based LiDAR Intensity Simulation
Realistic vehicle sensor simulation is an important element in developing autonomous driving. As physics-based implementations of visual sensors like LiDAR are complex in practice, data-based approaches promise solutions…
Autonomous Drivingobject-detectionObject Detection