RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects
We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the form of Doppler velocity. The main challenges of using Radar are the noise and measurement ambiguities which have been a struggle for existing simple input or output fusion methods. To better address this, we propose a new solution that exploits both LiDAR and Radar sensors for perception. Our approach, dubbed RadarNet, features a voxel-based early fusion and an attention-based late fusion, which learn from data to exploit both geometric and dynamic information of Radar data. RadarNet achieves state-of-the-art results on two large-scale real-world datasets in the tasks of object detection and velocity estimation. We further show that exploiting Radar improves the perception capabilities of detecting faraway objects and understanding the motion of dynamic objects.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionSimilar Papers 제목 키워드 기반
CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar
Robust perception is a vital component for ensuring safe autonomous and assisted driving. Automotive radar (77 to 81 GHz), which offers weather-resilient sensing, provides a complementary capability to the vision- or LiD…
3D Object Detection3D Object TrackingAutonomous DrivingObject+4NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Driving
Detecting obstacles is crucial for safe and efficient autonomous driving. To this end, we present NVRadarNet, a deep neural network (DNN) that detects dynamic obstacles and drivable free space using automotive RADAR sens…
Autonomous DrivingAutonomous VehiclesGPUTalk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension
Embodied perception is essential for intelligent vehicles and robots in interactive environmental understanding. However, these advancements primarily focus on vision, with limited attention given to using 3D modeling se…
3D visual groundingReferring ExpressionReferring Expression ComprehensionVisual GroundingMask-RadarNet: Enhancing Transformer With Spatial-Temporal Semantic Context for Radar Object Detection in Autonomous Driving
As a cost-effective and robust technology, automotive radar has seen steady improvement during the last years, making it an appealing complement to commonly used sensors like camera and LiDAR in autonomous driving. Radio…
Autonomous Drivingobject-detectionObject DetectionRadar Object DetectionExploiting Temporal Relations on Radar Perception for Autonomous Driving
We consider the object recognition problem in autonomous driving using automotive radar sensors. Comparing to Lidar sensors, radar is cost-effective and robust in all-weather conditions for perception in autonomous drivi…
2D Object DetectionAutonomous DrivingMultiple Object TrackingObject+4