Deep learning for radar data exploitation of autonomous vehicle
Autonomous driving requires a detailed understanding of complex driving scenes. The redundancy and complementarity of the vehicle's sensors provide an accurate and robust comprehension of the environment, thereby increasing the level of performance and safety. This thesis focuses the on automotive RADAR, which is a low-cost active sensor measuring properties of surrounding objects, including their relative speed, and has the key advantage of not being impacted by adverse weather conditions. With the rapid progress of deep learning and the availability of public driving datasets, the perception ability of vision-based driving systems has considerably improved. The RADAR sensor is seldom used for scene understanding due to its poor angular resolution, the size, noise, and complexity of RADAR raw data as well as the lack of available datasets. This thesis proposes an extensive study of RADAR scene understanding, from the construction of an annotated dataset to the conception of adapted deep learning architectures. First, this thesis details approaches to tackle the current lack of data. A simple simulation as well as generative methods for creating annotated data will be presented. It will also describe the CARRADA dataset, composed of synchronised camera and RADAR data with a semi-automatic annotation method. This thesis then present a proposed set of deep learning architectures with their associated loss functions for RADAR semantic segmentation. It also introduces a method to open up research into the fusion of LiDAR and RADAR sensors for scene understanding. Finally, this thesis exposes a collaborative contribution, the RADIal dataset with synchronised High-Definition (HD) RADAR, LiDAR and camera. A deep learning architecture is also proposed to estimate the RADAR signal processing pipeline while performing multitask learning for object detection and free driving space segmentation.
Code (1)
Tasks
Autonomous DrivingDeep Learningobject-detectionObject DetectionScene UnderstandingSemantic SegmentationSimilar Papers 제목 키워드 기반
The Radar Ghost Dataset -- An Evaluation of Ghost Objects in Automotive Radar Data
Radar sensors have a long tradition in advanced driver assistance systems (ADAS) and also play a major role in current concepts for autonomous vehicles. Their importance is reasoned by their high robustness against meteo…
Autonomous VehiclesV2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perception
Modern autonomous vehicle perception systems often struggle with occlusions and limited perception range. Previous studies have demonstrated the effectiveness of cooperative perception in extending the perception range a…
Autonomous DrivingMVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detection
4D radar is recognized for its resilience and cost-effectiveness under adverse weather conditions, thus playing a pivotal role in autonomous driving. While cameras and LiDAR are typically the primary sensors used in perc…
3D Object DetectionAutonomous DrivingAutonomous Vehiclesobject-detection+2A Survey of Deep Learning Based Radar and Vision Fusion for 3D Object Detection in Autonomous Driving
With the rapid advancement of autonomous driving technology, there is a growing need for enhanced safety and efficiency in the automatic environmental perception of vehicles during their operation. In modern vehicle setu…
3D Object DetectionAutonomous DrivingAutonomous Vehiclesobject-detection+1Radar Interference Mitigation for Automated Driving
Autonomous driving relies on a variety of sensors, especially on radars, which have unique robustness under heavy rain/fog/snow and poor light conditions. With the rapid increase of the amount of radars used on modern ve…
Autonomous Driving