Self-Supervised Large Scale Point Cloud Completion for Archaeological Site Restoration
Point cloud completion helps restore partial incomplete point clouds suffering occlusions. Current self-supervised methods fail to give high fidelity completion for large objects with missing surfaces and unbalanced distribution of available points. In this paper, we present a novel method for restoring large-scale point clouds with limited and imbalanced ground-truth. Using rough boundary annotations for a region of interest, we project the original point clouds into a multiple-center-of-projection (MCOP) image, where fragments are projected to images of 5 channels (RGB, depth, and rotation). Completion of the original point cloud is reduced to inpainting the missing pixels in the MCOP images. Due to lack of complete structures and an unbalanced distribution of existing parts, we develop a self-supervised scheme which learns to infill the MCOP image with points resembling existing "complete" patches. Special losses are applied to further enhance the regularity and consistency of completed MCOP images, which is mapped back to 3D to form final restoration. Extensive experiments demonstrate the superiority of our method in completing 600+ incomplete and unbalanced archaeological structures in Peru.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation
Large-scale point cloud semantic segmentation has wide applications. Current popular researches mainly focus on fully supervised learning which demands expensive and tedious manual point-wise annotation. Weakly super…
Self-Supervised LearningSemantic SegmentationWeakly-supervised LearningMortonNet: Self-Supervised Learning of Local Features in 3D Point Clouds
We present a self-supervised task on point clouds, in order to learn meaningful point-wise features that encode local structure around each point. Our self-supervised network, named MortonNet, operates directly on unstru…
SegmentationSelf-Supervised LearningSemantic SegmentationSelf-supervised Learning for Pre-Training 3D Point Clouds: A Survey
Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes…
3D geometryAutonomous DrivingRepresentation LearningSelf-Supervised LearningSelf-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation
Point clouds upsampling is a challenging issue to generate dense and uniform point clouds from the given sparse input. Most existing methods either take the end-to-end supervised learning based manner, where large amount…
Self-Supervised LearningWeakly Supervised Semantic Segmentation for Large-Scale Point Cloud
Existing methods for large-scale point cloud semantic segmentation require expensive, tedious and error-prone manual point-wise annotations. Intuitively, weakly supervised training is a direct solution to reduce the cost…
ColorizationPseudo LabelSelf-Supervised LearningSemantic Segmentation+2