BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View
Autonomous driving perceives its surroundings for decision making, which is one of the most complex scenarios in visual perception. The success of paradigm innovation in solving the 2D object detection task inspires us to seek an elegant, feasible, and scalable paradigm for fundamentally pushing the performance boundary in this area. To this end, we contribute the BEVDet paradigm in this paper. BEVDet performs 3D object detection in Bird-Eye-View (BEV), where most target values are defined and route planning can be handily performed. We merely reuse existing modules to build its framework but substantially develop its performance by constructing an exclusive data augmentation strategy and upgrading the Non-Maximum Suppression strategy. In the experiment, BEVDet offers an excellent trade-off between accuracy and time-efficiency. As a fast version, BEVDet-Tiny scores 31.2% mAP and 39.2% NDS on the nuScenes val set. It is comparable with FCOS3D, but requires just 11% computational budget of 215.3 GFLOPs and runs 9.2 times faster at 15.6 FPS. Another high-precision version dubbed BEVDet-Base scores 39.3% mAP and 47.2% NDS, significantly exceeding all published results. With a comparable inference speed, it surpasses FCOS3D by a large margin of +9.8% mAP and +10.0% NDS. The source code is publicly available for further research at https://github.com/HuangJunJie2017/BEVDet .
Code (2)
Tasks
3D Object DetectionAutonomous DrivingData Augmentationobject-detectionObject DetectionRobust Camera Only 3D Object DetectionSimilar Papers 제목 키워드 기반
RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Network
Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehe…
3D Multi-Object Tracking3D Object DetectionAutonomous DrivingMulti-Object Tracking+5BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detection
Single frame data contains finite information which limits the performance of the existing vision-based multi-camera 3D object detection paradigms. For fundamentally pushing the performance boundary in this area, a novel…
3D Object Detectionobject-detectionObject DetectionRCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection
Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. Howe…
3D Object Detection3D Object Detection (RoI)Autonomous DrivingObject+3ROA-BEV: 2D Region-Oriented Attention for BEV-based 3D Object
Vision-based BEV (Bird-Eye-View) 3D object detection has recently become popular in autonomous driving. However, objects with a high similarity to the background from a camera perspective cannot be detected well by exist…
3D Object DetectionAutonomous Drivingobject-detectionObject DetectionCR3DT: Camera-RADAR Fusion for 3D Detection and Tracking
To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of ca…
3D Multi-Object Tracking3D Object DetectionAutonomous DrivingMulti-Object Tracking+3