paper-with-me

Papers

Probabilistic and Geometric Depth: Detecting Objects in Perspective

2021-07-29 · Tai Wang, Xinge Zhu, Jiangmiao Pang, Dahua Lin

3D object detection is an important capability needed in various practical applications such as driver assistance systems. Monocular 3D detection, as a representative general setting among image-based approaches, provides a more economical solution than conventional settings relying on LiDARs but still yields unsatisfactory results. This paper first presents a systematic study on this problem. We observe that the current monocular 3D detection can be simplified as an instance depth estimation problem: The inaccurate instance depth blocks all the other 3D attribute predictions from improving the overall detection performance. Moreover, recent methods directly estimate the depth based on isolated instances or pixels while ignoring the geometric relations across different objects. To this end, we construct geometric relation graphs across predicted objects and use the graph to facilitate depth estimation. As the preliminary depth estimation of each instance is usually inaccurate in this ill-posed setting, we incorporate a probabilistic representation to capture the uncertainty. It provides an important indicator to identify confident predictions and further guide the depth propagation. Despite the simplicity of the basic idea, our method, PGD, obtains significant improvements on KITTI and nuScenes benchmarks, achieving 1st place out of all monocular vision-only methods while still maintaining real-time efficiency. Code and models will be released at https://github.com/open-mmlab/mmdetection3d.

📄 PDF Abstract BibTeX arXiv:2107.14160

Code (1)

open-mmlab/mmdetection3d 공식 구현 pytorch

Tasks

3D Object DetectionAttributeDepth EstimationMonocular 3D Object Detectionobject-detectionObject Detection

Similar Papers 제목 키워드 기반

GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusion

2024-12-08 · Karlo Koledic, Luka Petrovic, Ivan Markovic, Ivan Petrovic

Generalizing metric monocular depth estimation presents a significant challenge due to its ill-posed nature, while the entanglement between camera parameters and depth amplifies issues further, hindering multi-dataset tr…

Autonomous DrivingAutonomous VehiclesDepth EstimationMonocular Depth Estimation

GOOD: Exploring Geometric Cues for Detecting Objects in an Open World

2022-12-22 · Haiwen Huang, Andreas Geiger, Dan Zhang

We address the task of open-world class-agnostic object detection, i.e., detecting every object in an image by learning from a limited number of base object classes. State-of-the-art RGB-based models suffer from overfitt…

Class-agnostic Object DetectionObjectobject-detectionObject Detection+1

Extended Gaze Following: Detecting Objects in Videos Beyond the Camera Field of View

2019-02-28 · Benoit Massé, Stéphane Lathuilière, Pablo Mesejo, Radu Horaud

In this paper we address the problems of detecting objects of interest in a video and of estimating their locations, solely from the gaze directions of people present in the video. Objects can be indistinctly located ins…

Decoder

ProDepth: Boosting Self-Supervised Multi-Frame Monocular Depth with Probabilistic Fusion

2024-07-12 · Sungmin Woo, Wonjoon Lee, Woo Jin Kim, Dogyoon Lee 외

Self-supervised multi-frame monocular depth estimation relies on the geometric consistency between successive frames under the assumption of a static scene. However, the presence of moving objects in dynamic scenes intro…

DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1

Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D

2026-04-06 · Daniel DeTone, Tianwei Shen, Fan Zhang, Lingni Ma 외 arxiv

Detecting and localizing objects in space is a fundamental computer vision problem. While much progress has been made to solve 2D object detection, 3D object localization is much less explored and far from solved, especi…

Object Localization2D Object Detection