GeoTeacher: Geometry-Guided Semi-Supervised 3D Object Detection
Semi-supervised 3D object detection, aiming to explore unlabeled data for boosting 3D object detectors, has emerged as an active research area in recent years. Some previous methods have shown substantial improvements by either employing heterogeneous teacher models to provide high-quality pseudo labels or enforcing feature-perspective consistency between the teacher and student networks. However, these methods overlook the fact that the model usually tends to exhibit low sensitivity to object geometries with limited labeled data, making it difficult to capture geometric information, which is crucial for enhancing the student model's ability in object perception and localization. In this paper, we propose GeoTeacher to enhance the student model's ability to capture geometric relations of objects with limited training data, especially unlabeled data. We design a keypoint-based geometric relation supervision module that transfers the teacher model's knowledge of object geometry to the student, thereby improving the student's capability in understanding geometric relations. Furthermore, we introduce a voxel-wise data augmentation strategy that increases the diversity of object geometries, thereby further improving the student model's ability to comprehend geometric structures. To preserve the integrity of distant objects during augmentation, we incorporate a distance-decay mechanism into this strategy. Moreover, GeoTeacher can be combined with different SS3D methods to further improve their performance. Extensive experiments on the ONCE and Waymo datasets indicate the effectiveness and generalization of our method and we achieve the new state-of-the-art results. Code will be available at https://github.com/SII-Whaleice/GeoTeacher
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionData AugmentationSimilar Papers 제목 키워드 기반
Hunting Sparsity: Density-Guided Contrastive Learning for Semi-Supervised Semantic Segmentation
Recent semi-supervised semantic segmentation methods combine pseudo labeling and consistency regularization to enhance model generalization from perturbation-invariant training. In this work, we argue that adequate s…
Contrastive LearningDensity EstimationSemantic SegmentationSemi-Supervised Semantic SegmentationData-Uncertainty Guided Multi-Phase Learning for Semi-Supervised Object Detection
In this paper, we delve into semi-supervised object detection where unlabeled images are leveraged to break through the upper bound of fully-supervised object detection models. Previous semi-supervised methods based on p…
Objectobject-detectionObject DetectionSemi-Supervised Object DetectionSemi-Supervised Disentanglement of Tactile Contact~Geometry from Sliding-Induced Shear
The sense of touch is fundamental to human dexterity. When mimicked in robotic touch, particularly by use of soft optical tactile sensors, it suffers from distortion due to motion-dependent shear. This complicates tactil…
DisentanglementDensity Crop-guided Semi-supervised Object Detection in Aerial Images
One of the important bottlenecks in training modern object detectors is the need for labeled images where bounding box annotations have to be produced for each object present in the image. This bottleneck is further exac…
Objectobject-detectionObject DetectionObject Detection In Aerial Images+1Flow-guided Semi-supervised Video Object Segmentation
We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relev…
DecoderObjectOptical Flow EstimationSegmentation+5