GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detection
Integrating LiDAR and camera information into Bird's-Eye-View (BEV) representation has emerged as a crucial aspect of 3D object detection in autonomous driving. However, existing methods are susceptible to the inaccurate calibration relationship between LiDAR and the camera sensor. Such inaccuracies result in errors in depth estimation for the camera branch, ultimately causing misalignment between LiDAR and camera BEV features. In this work, we propose a robust fusion framework called Graph BEV. Addressing errors caused by inaccurate point cloud projection, we introduce a Local Align module that employs neighbor-aware depth features via Graph matching. Additionally, we propose a Global Align module to rectify the misalignment between LiDAR and camera BEV features. Our Graph BEV framework achieves state-of-the-art performance, with an mAP of 70.1\%, surpassing BEV Fusion by 1.6\% on the nuscenes validation set. Importantly, our Graph BEV outperforms BEV Fusion by 8.3\% under conditions with misalignment noise.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous DrivingDepth EstimationGraph Matchingobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving
Feature misalignment in BEV perception is a critical yet often overlooked challenge in autonomous driving, especially under calibration uncertainties between LiDAR and camera sensors. To address this issue, we propose a …
Autonomous DrivingGraph MatchingTimealign: A multi-modal object detection method for time misalignment fusing in autonomous driving
The multi-modal perception methods are thriving in the autonomous driving field due to their better usage of complementary data from different sensors. Such methods depend on calibration and synchronization between senso…
Autonomous Drivingobject-detectionObject DetectionLarge Language Model Guided Progressive Feature Alignment for Multimodal UAV Object Detection
Existing multimodal UAV object detection methods often overlook the impact of semantic gaps between modalities, which makes it difficult to achieve accurate semantic and spatial alignments, limiting detection performance…
Language ModelingLanguage ModellingLarge Language ModelObject+2Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identification
Multi-modal object Re-IDentification (ReID) is devoted to retrieving specific objects through the exploitation of complementary multi-modal image information. Existing methods mainly concentrate on the fusion of multi-mo…
Weakly Misalignment-free Adaptive Feature Alignment for UAVs-based Multimodal Object Detection
Visible-infrared (RGB-IR) image fusion has shown great potentials in object detection based on unmanned aerial vehicles (UAVs). However the weakly misalignment problem between multimodal image pairs limits its perfor…
2D Object DetectionObjectobject-detectionObject Detection