Cloud Transformers: A Universal Approach To Point Cloud Processing Tasks
We present a new versatile building block for deep point cloud processing architectures that is equally suited for diverse tasks. This building block combines the ideas of spatial transformers and multi-view convolutional networks with the efficiency of standard convolutional layers in two and three-dimensional dense grids. The new block operates via multiple parallel heads, whereas each head differentiably rasterizes feature representations of individual points into a low-dimensional space, and then uses dense convolution to propagate information across points. The results of the processing of individual heads are then combined together resulting in the update of point features. Using the new block, we build architectures for both discriminative (point cloud segmentation, point cloud classification) and generative (point cloud inpainting and image-based point cloud reconstruction) tasks. The resulting architectures achieve state-of-the-art performance for these tasks, demonstrating the versatility of the new block for point cloud processing.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud ClassificationPoint cloud reconstructionPoint Cloud SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transformers in 3D Point Clouds: A Survey
Transformers have been at the heart of the Natural Language Processing (NLP) and Computer Vision (CV) revolutions. The significant success in NLP and CV inspired exploring the use of Transformers in point cloud processin…
object-detectionObject DetectionPoint Cloud ClassificationSurveyAdaptive Point Transformer
The recent surge in 3D data acquisition has spurred the development of geometric deep learning models for point cloud processing, boosted by the remarkable success of transformers in natural language processing. While po…
Point Cloud ClassificationPix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding
While Transformers have achieved impressive success in natural language processing and computer vision, their performance on 3D point clouds is relatively poor. This is mainly due to the limitation of Transformers: a dem…
3D Point Cloud ClassificationInductive BiasPoint Cloud ClassificationSemantic SegmentationZZ-Net: A Universal Rotation Equivariant Architecture for 2D Point Clouds
In this paper, we are concerned with rotation equivariance on 2D point cloud data. We describe a particular set of functions able to approximate any continuous rotation equivariant and permutation invariant function. Bas…
PIVOT-Net: Heterogeneous Point-Voxel-Tree-based Framework for Point Cloud Compression
The universality of the point cloud format enables many 3D applications, making the compression of point clouds a critical phase in practice. Sampled as discrete 3D points, a point cloud approximates 2D surface(s) embedd…