Simulating Automotive Radar with Lidar and Camera Inputs
Low-cost millimeter automotive radar has received more and more attention due to its ability to handle adverse weather and lighting conditions in autonomous driving. However, the lack of quality datasets hinders research and development. We report a new method that is able to simulate 4D millimeter wave radar signals including pitch, yaw, range, and Doppler velocity along with radar signal strength (RSS) using camera image, light detection and ranging (lidar) point cloud, and ego-velocity. The method is based on two new neural networks: 1) DIS-Net, which estimates the spatial distribution and number of radar signals, and 2) RSS-Net, which predicts the RSS of the signal based on appearance and geometric information. We have implemented and tested our method using open datasets from 3 different models of commercial automotive radar. The experimental results show that our method can successfully generate high-fidelity radar signals. Moreover, we have trained a popular object detection neural network with data augmented by our synthesized radar. The network outperforms the counterpart trained only on raw radar data, a promising result to facilitate future radar-based research and development.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Automatic Labelling & Semantic Segmentation with 4D Radar Tensors
In this paper, an automatic labelling process is presented for automotive datasets, leveraging on complementary information from LiDAR and camera. The generated labels are then used as ground truth with the corresponding…
Semantic Segmentationvehicle detectionWarping of Radar Data into Camera Image for Cross-Modal Supervision in Automotive Applications
We present an approach to automatically generate semantic labels for real recordings of automotive range-Doppler (RD) radar spectra. Such labels are required when training a neural network for object recognition from rad…
Direction of Arrival EstimationObject RecognitionScene Flow EstimationSemantic SegmentationPolarNet: Accelerated Deep Open Space Segmentation Using Automotive Radar in Polar Domain
Camera and Lidar processing have been revolutionized with the rapid development of deep learning model architectures. Automotive radar is one of the crucial elements of automated driver assistance and autonomous driving …
Autonomous DrivingDecision MakingCARRADA Dataset: Camera and Automotive Radar with Range-Angle-Doppler Annotations
High quality perception is essential for autonomous driving (AD) systems. To reach the accuracy and robustness that are required by such systems, several types of sensors must be combined. Currently, mostly cameras and l…
Autonomous DrivingSemantic SegmentationDAROD: A Deep Automotive Radar Object Detector on Range-Doppler maps
Due to the small number of raw data automotive radar datasets and the low resolution of such radar sensors, automotive radar object detection has been little explored with deep learning models in comparison to camera and…
2D Object DetectionObjectobject-detectionObject Detection+1