Towards Model Generalization for Monocular 3D Object Detection
Monocular 3D object detection (Mono3D) has achieved tremendous improvements with emerging large-scale autonomous driving datasets and the rapid development of deep learning techniques. However, caused by severe domain gaps (e.g., the field of view (FOV), pixel size, and object size among datasets), Mono3D detectors have difficulty in generalization, leading to drastic performance degradation on unseen domains. To solve these issues, we combine the position-invariant transform and multi-scale training with the pixel-size depth strategy to construct an effective unified camera-generalized paradigm (CGP). It fully considers discrepancies in the FOV and pixel size of images captured by different cameras. Moreover, we further investigate the obstacle in quantitative metrics when cross-dataset inference through an exhaustive systematic study. We discern that the size bias of prediction leads to a colossal failure. Hence, we propose the 2D-3D geometry-consistent object scaling strategy (GCOS) to bridge the gap via an instance-level augment. Our method called DGMono3D achieves remarkable performance on all evaluated datasets and surpasses the SoTA unsupervised domain adaptation scheme even without utilizing data on the target domain.
Code (0)
등록된 구현이 없습니다.
Tasks
3D geometry3D Object DetectionAutonomous DrivingDomain AdaptationmodelMonocular 3D Object DetectionObjectobject-detectionObject DetectionUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
MAGneT-3D: Monocular and Domain-Generalizable Temporal 3D Detection
Monocular temporal 3D detection aims to detect objects in 3D, given a monocular video. Query-based 3D detectors unify detection and cross-view association, but their learnable queries fit the spatial distribution of the …
Domain Generalization3D Object DetectionEvery Dataset Counts: Scaling up Monocular 3D Object Detection with Joint Datasets Training
Monocular 3D object detection plays a crucial role in autonomous driving. However, existing monocular 3D detection algorithms depend on 3D labels derived from LiDAR measurements, which are costly to acquire for new datas…
3D Object DetectionAutonomous DrivingMonocular 3D Object Detectionobject-detection+13D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detection
Monocular 3D object detection is valuable for various applications such as robotics and AR/VR. Existing methods are confined to closed-set settings, where the training and testing sets consist of the same scenes and/or o…
Monocular 3D Object DetectionOpen Vocabulary Monocular 3D Object Detection
In this work, we pioneer the study of open-vocabulary monocular 3D object detection, a novel task that aims to detect and localize objects in 3D space from a single RGB image without limiting detection to a predefined se…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+3Towards Generalization Across Depth for Monocular 3D Object Detection
While expensive LiDAR and stereo camera rigs have enabled the development of successful 3D object detection methods, monocular RGB-only approaches lag much behind. This work advances the state of the art by introducing M…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1