PU-Transformer: Point Cloud Upsampling Transformer
Given the rapid development of 3D scanners, point clouds are becoming popular in AI-driven machines. However, point cloud data is inherently sparse and irregular, causing significant difficulties for machine perception. In this work, we focus on the point cloud upsampling task that intends to generate dense high-fidelity point clouds from sparse input data. Specifically, to activate the transformer's strong capability in representing features, we develop a new variant of a multi-head self-attention structure to enhance both point-wise and channel-wise relations of the feature map. In addition, we leverage a positional fusion block to comprehensively capture the local context of point cloud data, providing more position-related information about the scattered points. As the first transformer model introduced for point cloud upsampling, we demonstrate the outstanding performance of our approach by comparing with the state-of-the-art CNN-based methods on different benchmarks quantitatively and qualitatively.
Code (2)
Tasks
point cloud upsamplingSimilar Papers 제목 키워드 기반
PU-EdgeFormer: Edge Transformer for Dense Prediction in Point Cloud Upsampling
Despite the recent development of deep learning-based point cloud upsampling, most MLP-based point cloud upsampling methods have limitations in that it is difficult to train the local and global structure of the point cl…
point cloud upsamplingArbitrary Point Cloud Upsampling with Spherical Mixture of Gaussians
Generating dense point clouds from sparse raw data benefits downstream 3D understanding tasks, but existing models are limited to a fixed upsampling ratio or to a short range of integer values. In this paper, we present …
Decoderpoint cloud upsamplingDMF-Net: Image-Guided Point Cloud Completion with Dual-Channel Modality Fusion and Shape-Aware Upsampling Transformer
In this paper we study the task of a single-view image-guided point cloud completion. Existing methods have got promising results by fusing the information of image into point cloud explicitly or implicitly. However, giv…
Point Cloud CompletionTULIP: Transformer for Upsampling of LiDAR Point Clouds
LiDAR Upsampling is a challenging task for the perception systems of robots and autonomous vehicles, due to the sparse and irregular structure of large-scale scene contexts. Recent works propose to solve this problem by …
Autonomous VehiclesImage Super-ResolutionSuper-ResolutionPU-Ray: Domain-Independent Point Cloud Upsampling via Ray Marching on Neural Implicit Surface
While recent advancements in deep-learning point cloud upsampling methods have improved the input to intelligent transportation systems, they still suffer from issues of domain dependency between synthetic and real-scann…
Autonomous DrivingDepth EstimationDepth Predictionpoint cloud upsampling+1