paper-with-me

Papers

Geometry Uncertainty Projection Network for Monocular 3D Object Detection

2021-07-29 · ICCV 2021 10 · Yan Lu, Xinzhu Ma, Lei Yang, Tianzhu Zhang, Yating Liu, Qi Chu, Junjie Yan, Wanli Ouyang

Geometry Projection is a powerful depth estimation method in monocular 3D object detection. It estimates depth dependent on heights, which introduces mathematical priors into the deep model. But projection process also introduces the error amplification problem, in which the error of the estimated height will be amplified and reflected greatly at the output depth. This property leads to uncontrollable depth inferences and also damages the training efficiency. In this paper, we propose a Geometry Uncertainty Projection Network (GUP Net) to tackle the error amplification problem at both inference and training stages. Specifically, a GUP module is proposed to obtains the geometry-guided uncertainty of the inferred depth, which not only provides high reliable confidence for each depth but also benefits depth learning. Furthermore, at the training stage, we propose a Hierarchical Task Learning strategy to reduce the instability caused by error amplification. This learning algorithm monitors the learning situation of each task by a proposed indicator and adaptively assigns the proper loss weights for different tasks according to their pre-tasks situation. Based on that, each task starts learning only when its pre-tasks are learned well, which can significantly improve the stability and efficiency of the training process. Extensive experiments demonstrate the effectiveness of the proposed method. The overall model can infer more reliable object depth than existing methods and outperforms the state-of-the-art image-based monocular 3D detectors by 3.74% and 4.7% AP40 of the car and pedestrian categories on the KITTI benchmark.

📄 PDF Abstract BibTeX arXiv:2107.13774

Code (1)

supermhp/gupnet 공식 구현 pytorch

Tasks

3D Object Detection3D Object Detection From Monocular ImagesDepth EstimationMonocular 3D Object DetectionObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detection

2023-10-24 · Yan Lu, Xinzhu Ma, Lei Yang, Tianzhu Zhang 외

Geometry plays a significant role in monocular 3D object detection. It can be used to estimate object depth by using the perspective projection between object's physical size and 2D projection in the image plane, which c…

3D Object DetectionMonocular 3D Object Detectionobject-detectionObject Detection

MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors

2024-10-25 · CVPR 2025 1 · Fanqi Pu, Yifan Wang, Jiru Deng, Wenming Yang

Perspective projection has been extensively utilized in monocular 3D object detection methods. It introduces geometric priors from 2D bounding boxes and 3D object dimensions to reduce the uncertainty of depth estimation.…

3D Object DetectionDepth EstimationDepth PredictionMonocular 3D Object Detection+3

MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagation

2021-03-23 · CVPR 2021 1 · Hansheng Chen, Yuyao Huang, Wei Tian, Zhong Gao 외

Object localization in 3D space is a challenging aspect in monocular 3D object detection. Recent advances in 6DoF pose estimation have shown that predicting dense 2D-3D correspondence maps between image and object 3D mod…

3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+3

Shift R-CNN: Deep Monocular 3D Object Detection with Closed-Form Geometric Constraints

2019-05-23 · Andretti Naiden, Vlad Paunescu, Gyeongmo Kim, ByeongMoon Jeon 외

We propose Shift R-CNN, a hybrid model for monocular 3D object detection, which combines deep learning with the power of geometry. We adapt a Faster R-CNN network for regressing initial 2D and 3D object properties and co…

3D Object DetectionDeep LearningDepth EstimationForm+4

Towards Unified 3D Object Detection via Algorithm and Data Unification

2024-02-28 · CVPR 2024 1 · Zhuoling Li, Xiaogang Xu, SerNam Lim, Hengshuang Zhao

Realizing unified 3D object detection, including both indoor and outdoor scenes, holds great importance in applications like robot navigation. However, involving various scenarios of data to train models poses challenges…

3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+2