paper-with-me

홈 › Papers

PU-Transformer: Point Cloud Upsampling Transformer

2021-11-24 · Shi Qiu, Saeed Anwar, Nick Barnes

Given the rapid development of 3D scanners, point clouds are becoming popular in AI-driven machines. However, point cloud data is inherently sparse and irregular, causing significant difficulties for machine perception. In this work, we focus on the point cloud upsampling task that intends to generate dense high-fidelity point clouds from sparse input data. Specifically, to activate the transformer's strong capability in representing features, we develop a new variant of a multi-head self-attention structure to enhance both point-wise and channel-wise relations of the feature map. In addition, we leverage a positional fusion block to comprehensively capture the local context of point cloud data, providing more position-related information about the scattered points. As the first transformer model introduced for point cloud upsampling, we demonstrate the outstanding performance of our approach by comparing with the state-of-the-art CNN-based methods on different benchmarks quantitatively and qualitatively.

📄 PDF Abstract BibTeX arXiv:2111.12242

Code (2)

shiqiu0419/pu-transformer 공식 구현
rhtm02/PU-Transformer pytorch

Tasks

point cloud upsampling

Similar Papers 제목 키워드 기반

PU-EdgeFormer: Edge Transformer for Dense Prediction in Point Cloud Upsampling

2023-05-02 · Dohoon Kim, Minwoo Shin, Joonki Paik

Despite the recent development of deep learning-based point cloud upsampling, most MLP-based point cloud upsampling methods have limitations in that it is difficult to train the local and global structure of the point cl…

point cloud upsampling

Arbitrary Point Cloud Upsampling with Spherical Mixture of Gaussians

2022-08-10 · Anthony Dell'Eva, Marco Orsingher, Massimo Bertozzi

Generating dense point clouds from sparse raw data benefits downstream 3D understanding tasks, but existing models are limited to a fixed upsampling ratio or to a short range of integer values. In this paper, we present …

Decoderpoint cloud upsampling

DMF-Net: Image-Guided Point Cloud Completion with Dual-Channel Modality Fusion and Shape-Aware Upsampling Transformer

2024-06-25 · Aihua Mao, Yuxuan Tang, Jiangtao Huang, Ying He

In this paper we study the task of a single-view image-guided point cloud completion. Existing methods have got promising results by fusing the information of image into point cloud explicitly or implicitly. However, giv…

Point Cloud Completion

TULIP: Transformer for Upsampling of LiDAR Point Clouds

2023-12-11 · CVPR 2024 1 · Bin Yang, Patrick Pfreundschuh, Roland Siegwart, Marco Hutter 외

LiDAR Upsampling is a challenging task for the perception systems of robots and autonomous vehicles, due to the sparse and irregular structure of large-scale scene contexts. Recent works propose to solve this problem by …

Autonomous VehiclesImage Super-ResolutionSuper-Resolution

PU-Ray: Domain-Independent Point Cloud Upsampling via Ray Marching on Neural Implicit Surface

2023-10-12 · Sangwon Lim, Karim El-Basyouny, Yee Hong Yang

While recent advancements in deep-learning point cloud upsampling methods have improved the input to intelligent transportation systems, they still suffer from issues of domain dependency between synthetic and real-scann…

Autonomous DrivingDepth EstimationDepth Predictionpoint cloud upsampling+1