Weakly Supervised 3D Object Detection from Point Clouds
A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bounding boxes during training, while these annotations could be expensive to obtain and only accessible in limited scenarios. Weakly supervised learning is a promising approach to reducing the annotation requirement, but existing weakly supervised object detectors are mostly for 2D detection rather than 3D. In this work, we propose VS3D, a framework for weakly supervised 3D object detection from point clouds without using any ground truth 3D bounding box for training. First, we introduce an unsupervised 3D proposal module that generates object proposals by leveraging normalized point cloud densities. Second, we present a cross-modal knowledge distillation strategy, where a convolutional neural network learns to predict the final results from the 3D object proposals by querying a teacher network pretrained on image datasets. Comprehensive experiments on the challenging KITTI dataset demonstrate the superior performance of our VS3D in diverse evaluation settings. The source code and pretrained models are publicly available at https://github.com/Zengyi-Qin/Weakly-Supervised-3D-Object-Detection.
Code (1)
Tasks
3D Object DetectionKnowledge DistillationObjectobject-detectionObject DetectionScene UnderstandingWeakly-supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Weakly Supervised Point Clouds Transformer for 3D Object Detection
The annotation of 3D datasets is required for semantic-segmentation and object detection in scene understanding. In this paper we present a framework for the weakly supervision of a point clouds transformer that is used …
3D Object DetectionObjectobject-detectionObject Detection+2FGR: Frustum-Aware Geometric Reasoning for Weakly Supervised 3D Vehicle Detection
In this paper, we investigate the problem of weakly supervised 3D vehicle detection. Conventional methods for 3D object detection need vast amounts of manually labelled 3D data as supervision signals. However, annotating…
3D Object Detectionobject-detectionObject Detectionvehicle detectionWeakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistency
Monocular 3D object detection has become a mainstream approach in automatic driving for its easy application. A prominent advantage is that it does not need LiDAR point clouds during the inference. However, most current …
3D Object DetectionMonocular 3D Object Detectionobject-detectionObject DetectionMAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generator
Manually annotating 3D point clouds is laborious and costly, limiting the training data preparation for deep learning in real-world object detection. While a few previous studies tried to automatically generate 3D boundi…
object-detectionObject DetectionMVAT: Multi-View Aware Teacher for Weakly Supervised 3D Object Detection
Annotating 3D data remains a costly bottleneck for 3D object detection, motivating the development of weakly supervised annotation methods that rely on more accessible 2D box annotations. However, relying solely on 2D bo…
3D Object DetectionPoint Clouds