Monocular 3D Object Detection via Geometric Reasoning on Keypoints
Monocular 3D object detection is well-known to be a challenging vision task due to the loss of depth information; attempts to recover depth using separate image-only approaches lead to unstable and noisy depth estimates, harming 3D detections. In this paper, we propose a novel keypoint-based approach for 3D object detection and localization from a single RGB image. We build our multi-branch model around 2D keypoint detection in images and complement it with a conceptually simple geometric reasoning method. Our network performs in an end-to-end manner, simultaneously and interdependently estimating 2D characteristics, such as 2D bounding boxes, keypoints, and orientation, along with full 3D pose in the scene. We fuse the outputs of distinct branches, applying a reprojection consistency loss during training. The experimental evaluation on the challenging KITTI dataset benchmark demonstrates that our network achieves state-of-the-art results among other monocular 3D detectors.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionKeypoint DetectionMonocular 3D Object DetectionObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection
Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object's geometric shape has been ignored. In this work, we propose …
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving
In this work, we propose an efficient and accurate monocular 3D detection framework in single shot. Most successful 3D detectors take the projection constraint from the 3D bounding box to the 2D box as an important compo…
Autonomous DrivingVehicle Pose EstimationSingle-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometry Constrained Keypoints in Real-Time
In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification …
2D Object Detection3D Object DetectionAutonomous DrivingObject+2Monocular 3D Detection with Geometric Constraints Embedding and Semi-supervised Training
In this work, we propose a novel single-shot and keypoints-based framework for monocular 3D objects detection using only RGB images, called KM3D-Net. We design a fully convolutional model to predict object keypoints, dim…
AttributeInstance SegmentationPositionSemantic SegmentationUnsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priors
This paper introduces KeyDiff3D, a framework for unsupervised monocular 3D keypoints estimation that accurately predicts 3D keypoints from a single image. While previous methods rely on manual annotations or calibrated m…