paper-with-me

Papers

Point Cloud Classification Using Content-based Transformer via Clustering in Feature Space

2023-03-08 · Yahui Liu, Bin Tian, Yisheng Lv, Lingxi Li, FeiYue Wang

Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention, but ignore their content and fail to establish relationships between distant but relevant points. To overcome the limitation of local spatial attention, we propose a point content-based Transformer architecture, called PointConT for short. It exploits the locality of points in the feature space (content-based), which clusters the sampled points with similar features into the same class and computes the self-attention within each class, thus enabling an effective trade-off between capturing long-range dependencies and computational complexity. We further introduce an Inception feature aggregator for point cloud classification, which uses parallel structures to aggregate high-frequency and low-frequency information in each branch separately. Extensive experiments show that our PointConT model achieves a remarkable performance on point cloud shape classification. Especially, our method exhibits 90.3% Top-1 accuracy on the hardest setting of ScanObjectNN. Source code of this paper is available at https://github.com/yahuiliu99/PointConT.

📄 PDF Abstract BibTeX arXiv:2303.04599

Code (1)

yahuiliu99/pointcont 공식 구현 pytorch

Tasks

3D Point Cloud ClassificationClassificationClusteringPoint Cloud ClassificationSupervised Only 3D Point Cloud Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
fail 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

PointClustering: Unsupervised Point Cloud Pre-Training Using Transformation Invariance in Clustering

2023-01-01 · CVPR 2023 1 · Fuchen Long, Ting Yao, Zhaofan Qiu, Lusong Li 외

Feature invariance under different data transformations, i.e., transformation invariance, can be regarded as a type of self-supervision for representation learning. In this paper, we present PointClustering, a new un…

ClusteringDeep ClusteringInductive BiasPhilosophy+2

Masked Clustering Prediction for Unsupervised Point Cloud Pre-training

2025-08-12 · Bin Ren, Xiaoshui Huang, Mengyuan Liu, Hong Liu 외 arxiv

Vision transformers (ViTs) have recently been widely applied to 3D point cloud understanding, with masked autoencoding as the predominant pre-training paradigm. However, the challenge of learning dense and informative se…

Unsupervised Pre-trainingSemantic SegmentationContrastive LearningObject Detection

3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis

2021-12-09 · Jianhui Yu, Chaoyi Zhang, Heng Wang, Dingxin Zhang 외

General point clouds have been increasingly investigated for different tasks, and recently Transformer-based networks are proposed for point cloud analysis. However, there are barely related works for medical point cloud…

3D Part Segmentation3D Point Cloud Classification

3D Learnable Supertoken Transformer for LiDAR Point Cloud Scene Segmentation

2024-05-23 · Dening Lu, Jun Zhou, Kyle Gao, Linlin Xu 외

3D Transformers have achieved great success in point cloud understanding and representation. However, there is still considerable scope for further development in effective and efficient Transformers for large-scale LiDA…

ClusteringScene Segmentation

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

2022-03-02 · Dening Lu, Qian Xie, Linlin Xu, Jonathan Li

Although accurate and fast point cloud classification is a fundamental task in 3D applications, it is difficult to achieve this purpose due to the irregularity and disorder of point clouds that make it challenging to ach…

ClassificationPoint Cloud Classification