Towards Long-Range 3D Object Detection for Autonomous Vehicles
3D object detection at long range is crucial for ensuring the safety and efficiency of self driving vehicles, allowing them to accurately perceive and react to objects, obstacles, and potential hazards from a distance. But most current state of the art LiDAR based methods are range limited due to sparsity at long range, which generates a form of domain gap between points closer to and farther away from the ego vehicle. Another related problem is the label imbalance for faraway objects, which inhibits the performance of Deep Neural Networks at long range. To address the above limitations, we investigate two ways to improve long range performance of current LiDAR based 3D detectors. First, we combine two 3D detection networks, referred to as range experts, one specializing at near to mid range objects, and one at long range 3D detection. To train a detector at long range under a scarce label regime, we further weigh the loss according to the labelled point's distance from ego vehicle. Second, we augment LiDAR scans with virtual points generated using Multimodal Virtual Points (MVP), a readily available image-based depth completion algorithm. Our experiments on the long range Argoverse2 (AV2) dataset indicate that MVP is more effective in improving long range performance, while maintaining a straightforward implementation. On the other hand, the range experts offer a computationally efficient and simpler alternative, avoiding dependency on image-based segmentation networks and perfect camera-LiDAR calibration.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous VehiclesDepth CompletionDepth EstimationObjectobject-detectionObject DetectionSelf-Driving CarsSimilar Papers 제목 키워드 기반
An Empirical Analysis of Range for 3D Object Detection
LiDAR-based 3D detection plays a vital role in autonomous navigation. Surprisingly, although autonomous vehicles (AVs) must detect both near-field objects (for collision avoidance) and far-field objects (for longer-term …
3D Object DetectionAutonomous NavigationAutonomous VehiclesCollision Avoidance+3Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detection
Autonomous highway driving, especially for long-haul heavy trucks, requires detecting objects at long ranges beyond 500 meters to satisfy braking distance requirements at high speeds. At long distances, vehicles and othe…
Autonomous DrivingObject DetectionCoFF: Cooperative Spatial Feature Fusion for 3D Object Detection on Autonomous Vehicles
To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may r…
3D Object DetectionAutonomous VehiclesObjectobject-detection+1nuScenes: A multimodal dataset for autonomous driving
Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking …
3D Object DetectionAutonomous DrivingAutonomous Vehiclesobject-detection+1Seeing With Sound: Long-range Acoustic Beamforming for Multimodal Scene Understanding
Existing autonomous vehicles primarily use sensors that rely on electromagnetic waves which are undisturbed in good environmental conditions but can suffer in adverse scenarios, such as low light or for objects with …
Autonomous Vehiclesobject-detectionObject DetectionScene Understanding