Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection
As an inherently ill-posed problem, depth estimation from single images is the most challenging part of monocular 3D object detection (M3OD). Many existing methods rely on preconceived assumptions to bridge the missing spatial information in monocular images, and predict a sole depth value for every object of interest. However, these assumptions do not always hold in practical applications. To tackle this problem, we propose a depth solving system that fully explores the visual clues from the subtasks in M3OD and generates multiple estimations for the depth of each target. Since the depth estimations rely on different assumptions in essence, they present diverse distributions. Even if some assumptions collapse, the estimations established on the remaining assumptions are still reliable. In addition, we develop a depth selection and combination strategy. This strategy is able to remove abnormal estimations caused by collapsed assumptions, and adaptively combine the remaining estimations into a single one. In this way, our depth solving system becomes more precise and robust. Exploiting the clues from multiple subtasks of M3OD and without introducing any extra information, our method surpasses the current best method by more than 20% relatively on the Moderate level of test split in the KITTI 3D object detection benchmark, while still maintaining real-time efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionDepth EstimationDiversityMonocular 3D Object DetectionObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
MonoUNI: A Unified Vehicle and Infrastructure-side Monocular 3D Object Detection Network with Sufficient Depth Clues
Monocular 3D detection of vehicle and infrastructure sides are two important topics in autonomous driving. Due to diverse sensor installations and focal lengths, researchers are faced with the challenge of constructing a…
3D Object DetectionAutonomous DrivingMonocular 3D Object Detectionobject-detection+1MonoCD: Monocular 3D Object Detection with Complementary Depths
Monocular 3D object detection has attracted widespread attention due to its potential to accurately obtain object 3D localization from a single image at a low cost. Depth estimation is an essential but challenging subtas…
3D Object DetectionDepth EstimationDepth PredictionMonocular 3D Object Detection+3Diversifying Neural Text Generation with Part-of-Speech Guided Softmax and Sampling
Neural text generation models are likely to suffer from the low-diversity problem. Various decoding strategies and training-based methods have been proposed to promote diversity only by exploiting contextual features, bu…
DiversityPOSText GenerationDiversifying Neural Text Generation with Part-of-Speech Guided Softmax and Sampling
Neural text generation models are likely to suffer from the low-diversity problem. Various decoding strategies and training-based methods have been proposed to promote diversity only by exploiting contextual features, bu…
DiversityPOSText GenerationPDDM: Pseudo Depth Diffusion Model for RGB-PD Semantic Segmentation Based in Complex Indoor Scenes
The integration of RGB and depth modalities significantly enhances the accuracy of segmenting complex indoor scenes, with depth data from RGB-D cameras playing a crucial role in this improvement. However, collecting an R…
Depth EstimationSegmentationSemantic Segmentation