paper-with-me

홈 › Papers

Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds

2021-06-07 · Kaizhi Yang, Xuejin Chen

Representing complex 3D objects as simple geometric primitives, known as shape abstraction, is important for geometric modeling, structural analysis, and shape synthesis. In this paper, we propose an unsupervised shape abstraction method to map a point cloud into a compact cuboid representation. We jointly predict cuboid allocation as part segmentation and cuboid shapes and enforce the consistency between the segmentation and shape abstraction for self-learning. For the cuboid abstraction task, we transform the input point cloud into a set of parametric cuboids using a variational auto-encoder network. The segmentation network allocates each point into a cuboid considering the point-cuboid affinity. Without manual annotations of parts in point clouds, we design four novel losses to jointly supervise the two branches in terms of geometric similarity and cuboid compactness. We evaluate our method on multiple shape collections and demonstrate its superiority over existing shape abstraction methods. Moreover, based on our network architecture and learned representations, our approach supports various applications including structured shape generation, shape interpolation, and structural shape clustering.

📄 PDF Abstract BibTeX arXiv:2106.03437

Code (1)

SilenKZYoung/CuboidAbstractionViaSeg pytorch

Tasks

ClusteringSegmentationSelf-Learning

Similar Papers 제목 키워드 기반

Learning Fine-to-Coarse Cuboid Shape Abstraction

2025-02-03 · Gregor Kobsik, Morten Henkel, Yanjiang He, Victor Czech 외

The abstraction of 3D objects with simple geometric primitives like cuboids allows to infer structural information from complex geometry. It is important for 3D shape understanding, structural analysis and geometric mode…

Symmetry Detection

ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitives

2023-05-09 · R. Kenny Jones, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie

Programs are an increasingly popular representation for visual data, exposing compact, interpretable structure that supports manipulation. Visual programs are usually written in domain-specific languages (DSLs). Finding …

Robust Shape Fitting for 3D Scene Abstraction

2024-03-15 · Florian Kluger, Eric Brachmann, Michael Ying Yang, Bodo Rosenhahn

Humans perceive and construct the world as an arrangement of simple parametric models. In particular, we can often describe man-made environments using volumetric primitives such as cuboids or cylinders. Inferring these …

Depth EstimationScene Parsing

Im2Struct: Recovering 3D Shape Structure from a Single RGB Image

2018-04-16 · CVPR 2018 6 · Chengjie Niu, Jun Li, Kai Xu

We propose to recover 3D shape structures from single RGB images, where structure refers to shape parts represented by cuboids and part relations encompassing connectivity and symmetry. Given a single 2D image with an ob…

DecoderObject

Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives

2025-03-10 · Jiaxin Li, Hongxing Wang, Jiawei Tan, Zhilong Ou 외

Understanding 3D object shapes necessitates shape representation by object parts abstracted from results of instance and semantic segmentation. Promising shape representations enable computers to interpret a shape with m…

Instance SegmentationObjectSemantic SegmentationUnsupervised Object Segmentation