Generalizing Monocular 3D Object Detection
Monocular 3D object detection (Mono3D) is a fundamental computer vision task that estimates an object's class, 3D position, dimensions, and orientation from a single image. Its applications, including autonomous driving, augmented reality, and robotics, critically rely on accurate 3D environmental understanding. This thesis addresses the challenge of generalizing Mono3D models to diverse scenarios, including occlusions, datasets, object sizes, and camera parameters. To enhance occlusion robustness, we propose a mathematically differentiable NMS (GrooMeD-NMS). To improve generalization to new datasets, we explore depth equivariant (DEVIANT) backbones. We address the issue of large object detection, demonstrating that it's not solely a data imbalance or receptive field problem but also a noise sensitivity issue. To mitigate this, we introduce a segmentation-based approach in bird's-eye view with dice loss (SeaBird). Finally, we mathematically analyze the extrapolation of Mono3D models to unseen camera heights and improve Mono3D generalization in such out-of-distribution settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Monocular 3D Object DetectionAutonomous DrivingSimilar Papers 제목 키워드 기반
Deep Optics for Monocular Depth Estimation and 3D Object Detection
Depth estimation and 3D object detection are critical for scene understanding but remain challenging to perform with a single image due to the loss of 3D information during image capture. Recent models using deep neural …
3D Object DetectionDepth EstimationMonocular Depth EstimationObject+3SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objects
Monocular 3D detectors achieve remarkable performance on cars and smaller objects. However, their performance drops on larger objects, leading to fatal accidents. Some attribute the failures to training data scarcity or …
3D Object Detection3D Object Detection From Monocular ImagesAttributeBEV Segmentation+2Distance-Normalized Unified Representation for Monocular 3D Object Detection
Monocular 3D object detection plays an important role in autonomous driving and still remains challenging. To achieve fast and accurate monocular 3D object detection, we introduce a single-stage and multi-scale framework…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview
Object pose detection and tracking has recently attracted increasing attention due to its wide applications in many areas, such as autonomous driving, robotics, and augmented reality. Among methods for object pose detect…
Autonomous DrivingDeep LearningObjectPose TrackingSGM3D: Stereo Guided Monocular 3D Object Detection
Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed propert…
3D Object DetectionAutonomous DrivingDepth EstimationDomain Adaptation+4