Primitive Fitting Using Deep Boundary Aware Geometric Segmentation
To identify and fit geometric primitives (e.g., planes, spheres, cylinders, cones) in a noisy point cloud is a challenging yet beneficial task for fields such as robotics and reverse engineering. As a multi-model multi-instance fitting problem, it has been tackled with different approaches including RANSAC, which however often fit inferior models in practice with noisy inputs of cluttered scenes. Inspired by the corresponding human recognition process, and benefiting from the recent advancements in image semantic segmentation using deep neural networks, we propose BAGSFit as a new framework addressing this problem. Firstly, through a fully convolutional neural network, the input point cloud is point-wisely segmented into multiple classes divided by jointly detected instance boundaries without any geometric fitting. Thus, segments can serve as primitive hypotheses with a probability estimation of associating primitive classes. Finally, all hypotheses are sent through a geometric verification to correct any misclassification by fitting primitives respectively. We performed training using simulated range images and tested it with both simulated and real-world point clouds. Quantitative and qualitative experiments demonstrated the superiority of BAGSFit.
Code (1)
Tasks
Semantic SegmentationSimilar Papers 제목 키워드 기반
Deep Algebraic Fitting for Multiple Circle Primitives Extraction from Raw Point Clouds
The shape of circle is one of fundamental geometric primitives of man-made engineering objects. Thus, extraction of circles from scanned point clouds is a quite important task in 3D geometry data processing. However, exi…
3D geometryPriFit: Learning to Fit Primitives Improves Few Shot Point Cloud Segmentation
We present PriFit, a semi-supervised approach for label-efficient learning of 3D point cloud segmentation networks. PriFit combines geometric primitive fitting with point-based representation learning. Its key idea is to…
Few-Shot LearningPoint Cloud SegmentationRepresentation LearningSegmentationBoundary-Aware Geometric Encoding for Semantic Segmentation of Point Clouds
Boundary information plays a significant role in 2D image segmentation, while usually being ignored in 3D point cloud segmentation where ambiguous features might be generated in feature extraction, leading to misclassifi…
Image SegmentationPoint Cloud SegmentationSegmentationSemantic SegmentationLight-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes
In user-generated-content (UGC) applications, non-expert users often rely on image-to-3D generative models to create 3D assets. In this context, primitive-based shape abstraction offers a promising solution for UGC scena…
BPNet: Bézier Primitive Segmentation on 3D Point Clouds
This paper proposes BPNet, a novel end-to-end deep learning framework to learn B\'ezier primitive segmentation on 3D point clouds. The existing works treat different primitive types separately, thus limiting them to fini…
Point Cloud SegmentationSegmentation