MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationships
Monocular 3D object detection is an essential component in autonomous driving while challenging to solve, especially for those occluded samples which are only partially visible. Most detectors consider each 3D object as an independent training target, inevitably resulting in a lack of useful information for occluded samples. To this end, we propose a novel method to improve the monocular 3D object detection by considering the relationship of paired samples. This allows us to encode spatial constraints for partially-occluded objects from their adjacent neighbors. Specifically, the proposed detector computes uncertainty-aware predictions for object locations and 3D distances for the adjacent object pairs, which are subsequently jointly optimized by nonlinear least squares. Finally, the one-stage uncertainty-aware prediction structure and the post-optimization module are dedicatedly integrated for ensuring the run-time efficiency. Experiments demonstrate that our method yields the best performance on KITTI 3D detection benchmark, by outperforming state-of-the-art competitors by wide margins, especially for the hard samples.
Code (1)
Tasks
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObjectobject-detectionObject DetectionVehicle Pose EstimationSimilar Papers 제목 키워드 기반
Revisiting Monocular 3D Object Detection from Scene-Level Depth Retargeting to Instance-Level Spatial Refinement
Monocular 3D object detection is challenging due to the lack of accurate depth. However, existing depth-assisted solutions still exhibit inferior performance, whose reason is universally acknowledged as the unsatisfactor…
3D Object DetectionDepth EstimationMonocular 3D Object DetectionMonocular Depth Estimation+3OCM3D: Object-Centric Monocular 3D Object Detection
Image-only and pseudo-LiDAR representations are commonly used for monocular 3D object detection. However, methods based on them have shortcomings of either not well capturing the spatial relationships in neighbored image…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1IDMS: Instance Depth for Multi-scale Monocular 3D Object Detection
Due to the lack of depth information of images and poor detection accuracy in monocular 3D object detection, we proposed the instance depth for multi-scale monocular 3D object detection method. Firstly, to enhance the mo…
3D Object DetectionAuxiliary LearningMonocular 3D Object DetectionObject+2Digging Into Output Representation for Monocular 3D Object Detection
Monocular 3D object detection aims to recognize and localize objects in 3D space from a single image. Recent researches have conducted remarkable advancements, while all of them follow a typical output representation in…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1MonoPGC: Monocular 3D Object Detection with Pixel Geometry Contexts
Monocular 3D object detection reveals an economical but challenging task in autonomous driving. Recently center-based monocular methods have developed rapidly with a great trade-off between speed and accuracy, where they…
3D Object DetectionAutonomous DrivingDepth EstimationMonocular 3D Object Detection+3