paper-with-me

Papers

Weakly Supervised Point Clouds Transformer for 3D Object Detection

2023-09-08 · Zuojin Tang, Bo Sun, Tongwei Ma, Daosheng Li, Zhenhui Xu

The annotation of 3D datasets is required for semantic-segmentation and object detection in scene understanding. In this paper we present a framework for the weakly supervision of a point clouds transformer that is used for 3D object detection. The aim is to decrease the required amount of supervision needed for training, as a result of the high cost of annotating a 3D datasets. We propose an Unsupervised Voting Proposal Module, which learns randomly preset anchor points and uses voting network to select prepared anchor points of high quality. Then it distills information into student and teacher network. In terms of student network, we apply ResNet network to efficiently extract local characteristics. However, it also can lose much global information. To provide the input which incorporates the global and local information as the input of student networks, we adopt the self-attention mechanism of transformer to extract global features, and the ResNet layers to extract region proposals. The teacher network supervises the classification and regression of the student network using the pre-trained model on ImageNet. On the challenging KITTI datasets, the experimental results have achieved the highest level of average precision compared with the most recent weakly supervised 3D object detectors.

📄 PDF Abstract BibTeX arXiv:2309.04105

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionObjectobject-detectionObject DetectionScene UnderstandingSemantic Segmentation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Residual Connection 설명 없음
Batch Normalization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Kaiming Initialization 설명 없음

Similar Papers 제목 키워드 기반

2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision

2023-10-19 · ICCV 2023 1 · Cheng-Kun Yang, Min-Hung Chen, Yung-Yu Chuang, Yen-Yu Lin

We present a Multimodal Interlaced Transformer (MIT) that jointly considers 2D and 3D data for weakly supervised point cloud segmentation. Research studies have shown that 2D and 3D features are complementary for point c…

DecoderPoint Cloud SegmentationSegmentationWeakly-supervised Learning

Weakly Supervised 3D Object Detection from Point Clouds

2020-07-28 · Zengyi Qin, Jinglu Wang, Yan Lu

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bo…

3D Object DetectionKnowledge DistillationObjectobject-detection+3

An MIL-Derived Transformer for Weakly Supervised Point Cloud Segmentation

2022-01-01 · CVPR 2022 1 · Cheng-Kun Yang, Ji-Jia Wu, Kai-Syun Chen, Yung-Yu Chuang 외

We address weakly supervised point cloud segmentation by proposing a new model, MIL-derived transformer, to mine additional supervisory signals. First, the transformer model is derived based on multiple instance lear…

Model OptimizationMultiple Instance LearningPoint Cloud Segmentation

Weakly-Supervised 3D Visual Grounding based on Visual Linguistic Alignment

2023-12-15 · Xiaoxu Xu, Yitian Yuan, Qiudan Zhang, Wenhui Wu 외

Learning to ground natural language queries to target objects or regions in 3D point clouds is quite essential for 3D scene understanding. Nevertheless, existing 3D visual grounding approaches require a substantial numbe…

3D visual groundingNatural Language QueriesScene UnderstandingVisual Grounding

EgoFlowNet: Non-Rigid Scene Flow from Point Clouds with Ego-Motion Support

2024-07-03 · Ramy Battrawy, René Schuster, Didier Stricker

Recent weakly-supervised methods for scene flow estimation from LiDAR point clouds are limited to explicit reasoning on object-level. These methods perform multiple iterative optimizations for each rigid object, which ma…

ClusteringObjectScene Flow Estimation