Pre-Training by Completing Point Clouds
There has recently been a flurry of exciting advances in deep learning models on point clouds. However, these advances have been hampered by the difficulty of creating labelled point cloud datasets: sparse point clouds often have unclear label identities for certain points, while dense point clouds are time-consuming to annotate. Inspired by mask-based pre-training in the natural language processing community, we propose a pre-training mechanism based point clouds completion. It works by masking occluded points that result from observations at different camera views. It then optimizes a completion model that learns how to reconstruct the occluded points, given the partial point cloud. In this way, our method learns a pre-trained representation that can identify the visual constraints inherently embedded in real-world point clouds. We call our method Occlusion Completion (OcCo). We demonstrate that OcCo learns representations that improve the semantic understandings as well as generalization on downstream tasks over prior methods, transfer to different datasets, reduce training time and improve label efficiency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors
3D point clouds directly collected from objects through sensors are often incomplete due to self-occlusion. Conventional methods for completing these partial point clouds rely on manually organized training sets and are …
ColorizationPoint Cloud CompletionDenoising-While-Completing Network (DWCNet): Robust Point Cloud Completion Under Corruption
Point cloud completion is crucial for 3D computer vision tasks in autonomous driving, augmented reality, and robotics. However, obtaining clean and complete point clouds from real-world environments is challenging due to…
Point Cloud CompletionContrastive LearningAutonomous DrivingPoint CloudsAutomatic marker-free registration based on similar tetrahedras for single-tree point clouds
In recent years, terrestrial laser scanning technology has been widely used to collect tree point cloud data, aiding in measurements of diameter at breast height, biomass, and other forestry survey data. Since a single s…
Point Cloud Registration3D Point Cloud Generation via Autoregressive Up-sampling
We introduce a pioneering autoregressive generative model for 3D point cloud generation. Inspired by visual autoregressive modeling (VAR), we conceptualize point cloud generation as an autoregressive up-sampling process.…
Point Cloud GenerationSparse SPN: Depth Completion from Sparse Keypoints
Our long term goal is to use image-based depth completion to quickly create 3D models from sparse point clouds, e.g. from SfM or SLAM. Much progress has been made in depth completion. However, most current works assume w…
Depth Completion