paper-with-me

홈 › Papers

Point Transformer

2020-12-16 · ICCV 2021 10 · Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip Torr, Vladlen Koltun

Self-attention networks have revolutionized natural language processing and are making impressive strides in image analysis tasks such as image classification and object detection. Inspired by this success, we investigate the application of self-attention networks to 3D point cloud processing. We design self-attention layers for point clouds and use these to construct self-attention networks for tasks such as semantic scene segmentation, object part segmentation, and object classification. Our Point Transformer design improves upon prior work across domains and tasks. For example, on the challenging S3DIS dataset for large-scale semantic scene segmentation, the Point Transformer attains an mIoU of 70.4% on Area 5, outperforming the strongest prior model by 3.3 absolute percentage points and crossing the 70% mIoU threshold for the first time.

📄 PDF Abstract BibTeX arXiv:2012.09164

Code (24)

Pointcept/Pointcept 공식 구현 pytorch
https://gitee.com/gai-shaoyan/mind3d
2023-MindSpore-1/ms-code-215/tree/main/pointtransformer mindspore
2023-MindSpore-1/ms-code-48 mindspore
KernelA/pytorch-point-transformer pytorch
MS-Mind/MS-Code-06/tree/main/pointtransformer mindspore
Meowuu7/Point-Transformer pytorch
Mind23-2/MindCode-5/tree/main/pointtransformer mindspore
MindSpore-paper-code-2/code2/tree/main/pointtransformer mindspore
POSTECH-CVLab/FastPointTransformer pytorch
POSTECH-CVLab/point-transformer pytorch
Sharpiless/Point-Transformer-Pytorch pytorch
alzmzyy/pointtransformer mindspore
code-implementation1/Code6/tree/main/pointtransformer mindspore
engelnico/point-transformer pytorch
gofinge/pointtransformerv2 pytorch
isl-org/Open3D-ML pytorch
jxl152/Point-Transformer pytorch
lifebeyondexpectations/eccv22-pointmixer pytorch
lucidrains/point-transformer-pytorch pytorch
qq456cvb/Point-Transformers pytorch
rauleun/point-transformer-tf2 tf
sh4175515/PointTransformer mindspore
tkdguraa/point-transformer-tensorflow tf

Tasks

3D Part Segmentation3D Point Cloud Classification3D Semantic SegmentationGeneral Classificationimage-classificationImage ClassificationObjectObject DetectionPoint Cloud SegmentationScene SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Adam 설명 없음
Attention 설명 없음

Similar Papers 제목 키워드 기반

Point Transformer

2020-11-02 · Nico Engel, Vasileios Belagiannis, Klaus Dietmayer

In this work, we present Point Transformer, a deep neural network that operates directly on unordered and unstructured point sets. We design Point Transformer to extract local and global features and relate both represen…

3D Object Classification3D Part Segmentation3D Point Cloud ClassificationSemantic Segmentation

NoiseTrans: Point Cloud Denoising with Transformers

2023-04-24 · Guangzhe Hou, Guihe Qin, Minghui Sun, Yanhua Liang 외

Point clouds obtained from capture devices or 3D reconstruction techniques are often noisy and interfere with downstream tasks. The paper aims to recover the underlying surface of noisy point clouds. We design a novel mo…

3D ReconstructionDenoising

Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding

2022-08-25 · Guocheng Qian, Abdullah Hamdi, Xingdi Zhang, Bernard Ghanem

While Transformers have achieved impressive success in natural language processing and computer vision, their performance on 3D point clouds is relatively poor. This is mainly due to the limitation of Transformers: a dem…

3D Point Cloud ClassificationInductive BiasPoint Cloud ClassificationSemantic Segmentation

PVTransformer: Point-to-Voxel Transformer for Scalable 3D Object Detection

2024-05-05 · Zhaoqi Leng, Pei Sun, Tong He, Dragomir Anguelov 외

3D object detectors for point clouds often rely on a pooling-based PointNet to encode sparse points into grid-like voxels or pillars. In this paper, we identify that the common PointNet design introduces an information b…

3D Object DetectionObjectobject-detectionObject Detection

DAPoinTr: Domain Adaptive Point Transformer for Point Cloud Completion

2024-12-26 · Yinghui Li, Qianyu Zhou, Jingyu Gong, Ye Zhu 외

Point Transformers (PoinTr) have shown great potential in point cloud completion recently. Nevertheless, effective domain adaptation that improves transferability toward target domains remains unexplored. In this paper, …

DecoderDomain AdaptationPoint Cloud CompletionPseudo Label