paper-with-me

홈 › Papers

PointCT: Point Central Transformer Network for Weakly-supervised Point Cloud Semantic Segmentation

2023-12-24 · Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 12 · Anh-Thuan Tran, Hoanh-Su Le, Suk-Hwan Lee, Ki-Ryong Kwon

Although point cloud segmentation has a principal role in 3D understanding, annotating fully large-scale scenes for this task can be costly and time-consuming. To resolve this issue, we propose Point Central Transformer (PointCT), a novel end-to-end trainable transformer network for weakly-supervised point cloud semantic segmentation. Divergent from prior approaches, our method addresses limited point annotation challenges exclusively based on 3D points through central-based attention. By employing two embedding processes, our attention mechanism integrates global features across neighborhoods, thereby effectively enhancing unlabeled point representations. Simultaneously, the interconnections between central points and their distinct neighborhoods are bidirectional cohered. Position encoding is further applied to enforce geometric features and improve overall performance. Notably, PointCT achieves outstanding performance under various labeled point settings without additional supervision. Extensive experiments on public datasets S3DIS, ScanNet-V2, and STPLS3D demonstrate the superiority of our proposed approach over other state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (1)

anhthuan1999/PointCT 공식 구현 pytorch

Tasks

3D Semantic SegmentationPoint Cloud SegmentationSegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

TransCrowd: weakly-supervised crowd counting with transformers

2021-04-19 · Dingkang Liang, Xiwu Chen, Wei Xu, Yu Zhou 외

The mainstream crowd counting methods usually utilize the convolution neural network (CNN) to regress a density map, requiring point-level annotations. However, annotating each person with a point is an expensive and lab…

Crowd Counting

2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision

2023-10-19 · ICCV 2023 1 · Cheng-Kun Yang, Min-Hung Chen, Yung-Yu Chuang, Yen-Yu Lin

We present a Multimodal Interlaced Transformer (MIT) that jointly considers 2D and 3D data for weakly supervised point cloud segmentation. Research studies have shown that 2D and 3D features are complementary for point c…

DecoderPoint Cloud SegmentationSegmentationWeakly-supervised Learning

A Simple Vision Transformer for Weakly Semi-supervised 3D Object Detection

2023-01-01 · ICCV 2023 1 · Dingyuan Zhang, Dingkang Liang, Zhikang Zou, Jingyu Li 외

Advanced 3D object detection methods usually rely on large-scale, elaborately labeled datasets to achieve good performance. However, labeling the bounding boxes for the 3D objects is difficult and expensive. Although…

3D Object DetectionObjectobject-detectionObject Detection

Weakly Supervised Point Clouds Transformer for 3D Object Detection

2023-09-08 · Zuojin Tang, Bo Sun, Tongwei Ma, Daosheng Li 외

The annotation of 3D datasets is required for semantic-segmentation and object detection in scene understanding. In this paper we present a framework for the weakly supervision of a point clouds transformer that is used …

3D Object DetectionObjectobject-detectionObject Detection+2

Weakly-Supervised Salient Object Detection Using Point Supervision

2022-03-22 · Shuyong Gao, Wei zhang, Yan Wang, Qianyu Guo 외

Current state-of-the-art saliency detection models rely heavily on large datasets of accurate pixel-wise annotations, but manually labeling pixels is time-consuming and labor-intensive. There are some weakly supervised m…

Objectobject-detectionObject DetectionSaliency Detection+1