paper-with-me

Papers

PointCAT: Cross-Attention Transformer for point cloud

2023-04-06 · Xincheng Yang, Mingze Jin, Weiji He, Qian Chen

Transformer-based models have significantly advanced natural language processing and computer vision in recent years. However, due to the irregular and disordered structure of point cloud data, transformer-based models for 3D deep learning are still in their infancy compared to other methods. In this paper we present Point Cross-Attention Transformer (PointCAT), a novel end-to-end network architecture using cross-attentions mechanism for point cloud representing. Our approach combines multi-scale features via two seprate cross-attention transformer branches. To reduce the computational increase brought by multi-branch structure, we further introduce an efficient model for shape classification, which only process single class token of one branch as a query to calculate attention map with the other. Extensive experiments demonstrate that our method outperforms or achieves comparable performance to several approaches in shape classification, part segmentation and semantic segmentation tasks.

📄 PDF Abstract BibTeX arXiv:2304.03012

Code (1)

xincheng-yang/pointcat 공식 구현 pytorch

Tasks

SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognition

2022-09-16 · Qidong Huang, Xiaoyi Dong, Dongdong Chen, Hang Zhou 외

Notwithstanding the prominent performance achieved in various applications, point cloud recognition models have often suffered from natural corruptions and adversarial perturbations. In this paper, we delve into boosting…

Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos

2021-06-19 · CVPR 2021 1 · Hehe Fan, Yi Yang, Mohan Kankanhalli

Point cloud videos exhibit irregularities and lack of order along the spatial dimension where points emerge inconsistently across different frames. To capture the dynamics in point cloud videos, point tracking is usu…

3D Action RecognitionAction RecognitionPoint TrackingSemantic Segmentation

PTTR: Relational 3D Point Cloud Object Tracking with Transformer

2021-12-06 · CVPR 2022 1 · Changqing Zhou, Zhipeng Luo, Yueru Luo, Tianrui Liu 외

In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in the current search point cloud given a template point cloud. Motivated by the success of transformers, we propose…

3D Object TrackingObjectObject TrackingPoint Tracking+1

VTPNet for 3D deep learning on point cloud

2023-05-10 · Wei Zhou, Weiwei Jin, Qian Wang, Yifan Wang 외

Recently, Transformer-based methods for point cloud learning have achieved good results on various point cloud learning benchmarks. However, since the attention mechanism needs to generate three feature vectors of query,…

Deep LearningSemantic Segmentation

Self-positioning Point-based Transformer for Point Cloud Understanding

2023-03-29 · CVPR 2023 1 · Jinyoung Park, Sanghyeok Lee, Sihyeon Kim, Yunyang Xiong 외

Transformers have shown superior performance on various computer vision tasks with their capabilities to capture long-range dependencies. Despite the success, it is challenging to directly apply Transformers on point clo…

3D Part Segmentation3D Point Cloud ClassificationScene SegmentationSemantic Segmentation+1