paper-with-me

Papers

Point Transformer

2020-11-02 · Nico Engel, Vasileios Belagiannis, Klaus Dietmayer

In this work, we present Point Transformer, a deep neural network that operates directly on unordered and unstructured point sets. We design Point Transformer to extract local and global features and relate both representations by introducing the local-global attention mechanism, which aims to capture spatial point relations and shape information. For that purpose, we propose SortNet, as part of the Point Transformer, which induces input permutation invariance by selecting points based on a learned score. The output of Point Transformer is a sorted and permutation invariant feature list that can directly be incorporated into common computer vision applications. We evaluate our approach on standard classification and part segmentation benchmarks to demonstrate competitive results compared to the prior work. Code is publicly available at: https://github.com/engelnico/point-transformer

📄 PDF Abstract BibTeX arXiv:2011.00931

Code (2)

engelnico/point-transformer 공식 구현 pytorch
qq456cvb/Point-Transformers pytorch

Tasks

3D Object Classification3D Part Segmentation3D Point Cloud ClassificationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

NoiseTrans: Point Cloud Denoising with Transformers

2023-04-24 · Guangzhe Hou, Guihe Qin, Minghui Sun, Yanhua Liang 외

Point clouds obtained from capture devices or 3D reconstruction techniques are often noisy and interfere with downstream tasks. The paper aims to recover the underlying surface of noisy point clouds. We design a novel mo…

3D ReconstructionDenoising

Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding

2022-08-25 · Guocheng Qian, Abdullah Hamdi, Xingdi Zhang, Bernard Ghanem

While Transformers have achieved impressive success in natural language processing and computer vision, their performance on 3D point clouds is relatively poor. This is mainly due to the limitation of Transformers: a dem…

3D Point Cloud ClassificationInductive BiasPoint Cloud ClassificationSemantic Segmentation

PVTransformer: Point-to-Voxel Transformer for Scalable 3D Object Detection

2024-05-05 · Zhaoqi Leng, Pei Sun, Tong He, Dragomir Anguelov 외

3D object detectors for point clouds often rely on a pooling-based PointNet to encode sparse points into grid-like voxels or pillars. In this paper, we identify that the common PointNet design introduces an information b…

3D Object DetectionObjectobject-detectionObject Detection

DAPoinTr: Domain Adaptive Point Transformer for Point Cloud Completion

2024-12-26 · Yinghui Li, Qianyu Zhou, Jingyu Gong, Ye Zhu 외

Point Transformers (PoinTr) have shown great potential in point cloud completion recently. Nevertheless, effective domain adaptation that improves transferability toward target domains remains unexplored. In this paper, …

DecoderDomain AdaptationPoint Cloud CompletionPseudo Label

Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos

2021-06-19 · CVPR 2021 1 · Hehe Fan, Yi Yang, Mohan Kankanhalli

Point cloud videos exhibit irregularities and lack of order along the spatial dimension where points emerge inconsistently across different frames. To capture the dynamics in point cloud videos, point tracking is usu…

3D Action RecognitionAction RecognitionPoint TrackingSemantic Segmentation