paper-with-me

홈 › Papers

Monocular 3D Object Detection via Geometric Reasoning on Keypoints

2019-05-14 · Ivan Barabanau, Alexey Artemov, Evgeny Burnaev, Vyacheslav Murashkin

Monocular 3D object detection is well-known to be a challenging vision task due to the loss of depth information; attempts to recover depth using separate image-only approaches lead to unstable and noisy depth estimates, harming 3D detections. In this paper, we propose a novel keypoint-based approach for 3D object detection and localization from a single RGB image. We build our multi-branch model around 2D keypoint detection in images and complement it with a conceptually simple geometric reasoning method. Our network performs in an end-to-end manner, simultaneously and interdependently estimating 2D characteristics, such as 2D bounding boxes, keypoints, and orientation, along with full 3D pose in the scene. We fuse the outputs of distinct branches, applying a reprojection consistency loss during training. The experimental evaluation on the challenging KITTI dataset benchmark demonstrates that our network achieves state-of-the-art results among other monocular 3D detectors.

📄 PDF Abstract BibTeX arXiv:1905.05618

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionKeypoint DetectionMonocular 3D Object DetectionObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

2021-08-25 · ICCV 2021 10 · Zongdai Liu, Dingfu Zhou, Feixiang Lu, Jin Fang 외

Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object's geometric shape has been ignored. In this work, we propose …

3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2

RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving

2020-01-10 · ECCV 2020 8 · Peixuan Li, Huaici Zhao, PengFei Liu, Feidao Cao

In this work, we propose an efficient and accurate monocular 3D detection framework in single shot. Most successful 3D detectors take the projection constraint from the 3D bounding box to the 2D box as an important compo…

Autonomous DrivingVehicle Pose Estimation

Single-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometry Constrained Keypoints in Real-Time

2020-06-23 · Nils Gählert, Jun-Jun Wan, Nicolas Jourdan, Jan Finkbeiner 외

In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification …

2D Object Detection3D Object DetectionAutonomous DrivingObject+2

Monocular 3D Detection with Geometric Constraints Embedding and Semi-supervised Training

2020-09-02 · Peixuan Li

In this work, we propose a novel single-shot and keypoints-based framework for monocular 3D objects detection using only RGB images, called KM3D-Net. We design a fully convolutional model to predict object keypoints, dim…

AttributeInstance SegmentationPositionSemantic Segmentation

Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priors

2025-07-16 · Subin Jeon, In Cho, Junyoung Hong, Seon Joo Kim

This paper introduces KeyDiff3D, a framework for unsupervised monocular 3D keypoints estimation that accurately predicts 3D keypoints from a single image. While previous methods rely on manual annotations or calibrated m…