RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detection
Radar hits reflect from points on both the boundary and internal to object outlines. This results in a complex distribution of radar hits that depends on factors including object category, size, and orientation. Current radar-camera fusion methods implicitly account for this with a black-box neural network. In this paper, we explicitly utilize a radar hit distribution model to assist fusion. First, we build a model to predict radar hit distributions conditioned on object properties obtained from a monocular detector. Second, we use the predicted distribution as a kernel to match actual measured radar points in the neighborhood of the monocular detections, generating matching scores at nearby positions. Finally, a fusion stage combines context with the kernel detector to refine the matching scores. Our method achieves the state-of-the-art radar-camera detection performance on nuScenes. Our source code is available at https://github.com/longyunf/riccardo.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
RCDPT: Radar-Camera fusion Dense Prediction Transformer
Recently, transformer networks have outperformed traditional deep neural networks in natural language processing and show a large potential in many computer vision tasks compared to convolutional backbones. In the origin…
Depth EstimationMonocular Depth EstimationPredictionREOcc: Camera-Radar Fusion with Radar Feature Enrichment for 3D Occupancy Prediction
Vision-based 3D occupancy prediction has made significant advancements, but its reliance on cameras alone struggles in challenging environments. This limitation has driven the adoption of sensor fusion, among which camer…
CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detection
Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+3RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale
We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings,…
Depth EstimationDepth PredictionRadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radar
3D occupancy-based perception pipeline has significantly advanced autonomous driving by capturing detailed scene descriptions and demonstrating strong generalizability across various object categories and shapes. Current…
Autonomous DrivingPredictionSelf-Driving Cars