Disp R-CNN: Stereo 3D Object Detection via Shape Prior Guided Instance Disparity Estimation
In this paper, we propose a novel system named Disp R-CNN for 3D object detection from stereo images. Many recent works solve this problem by first recovering a point cloud with disparity estimation and then apply a 3D detector. The disparity map is computed for the entire image, which is costly and fails to leverage category-specific prior. In contrast, we design an instance disparity estimation network (iDispNet) that predicts disparity only for pixels on objects of interest and learns a category-specific shape prior for more accurate disparity estimation. To address the challenge from scarcity of disparity annotation in training, we propose to use a statistical shape model to generate dense disparity pseudo-ground-truth without the need of LiDAR point clouds, which makes our system more widely applicable. Experiments on the KITTI dataset show that, even when LiDAR ground-truth is not available at training time, Disp R-CNN achieves competitive performance and outperforms previous state-of-the-art methods by 20% in terms of average precision.
Code (1)
Tasks
3D Object Detection3D Object Detection From Stereo ImagesDisparity Estimationobject-detectionObject DetectionVehicle Pose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Object-Centric Stereo Matching for 3D Object Detection
Safe autonomous driving requires reliable 3D object detection-determining the 6 DoF pose and dimensions of objects of interest. Using stereo cameras to solve this task is a cost-effective alternative to the widely used L…
3D Object Detection3D Object Detection From Stereo ImagesAutonomous DrivingDisparity Estimation+5Toward 3D Object Reconstruction from Stereo Images
Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These meth…
3D Object ReconstructionBenchmarkingObjectObject ReconstructionObject-Centric Stereo Ranging for Autonomous Driving: From Dense Disparity to Census-Based Template Matching
Accurate depth estimation is critical for autonomous driving perception systems, particularly for long range vehicle detection on highways. Traditional dense stereo matching methods such as Block Matching (BM) and Semi G…
Autonomous DrivingDepth EstimationStereoMV2D: A Sparse Temporal Stereo-Enhanced Framework for Robust Multi-View 3D Object Detection
Multi-view 3D object detection is a fundamental task in autonomous driving perception, where achieving a balance between detection accuracy and computational efficiency remains crucial. Sparse query-based 3D detectors ef…
Computational Efficiency3D Object DetectionAutonomous DrivingActive stereo vision three-dimensional reconstruction by RGB dot pattern projection and ray intersection
Active stereo vision is important in reconstructing objects without obvious textures. However, it is still very challenging to extract and match the projected patterns from two camera views automatically and robustly. In…