Unsupervised 3D Shape Reconstruction by Part Retrieval and Assembly
Representing a 3D shape with a set of primitives can aid perception of structure, improve robotic object manipulation, and enable editing, stylization, and compression of 3D shapes. Existing methods either use simple parametric primitives or learn a generative shape space of parts. Both have limitations: parametric primitives lead to coarse approximations, while learned parts offer too little control over the decomposition. We instead propose to decompose shapes using a library of 3D parts provided by the user, giving full control over the choice of parts. The library can contain parts with high-quality geometry that are suitable for a given category, resulting in meaningful decompositions with clean geometry. The type of decomposition can also be controlled through the choice of parts in the library. Our method works via a self-supervised approach that iteratively retrieves parts from the library and refines their placements. We show that this approach gives higher reconstruction accuracy and more desirable decompositions than existing approaches. Additionally, we show how the decomposition can be controlled through the part library by using different part libraries to reconstruct the same shapes.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Shape ReconstructionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ANISE: Assembly-based Neural Implicit Surface rEconstruction
We present ANISE, a method that reconstructs a 3D~shape from partial observations (images or sparse point clouds) using a part-aware neural implicit shape representation. The shape is formulated as an assembly of neural …
Point cloud reconstructionRetrievalSurface ReconstructionJigsaw++: Imagining Complete Shape Priors for Object Reassembly
The automatic assembly problem has attracted increasing interest due to its complex challenges that involve 3D representation. This paper introduces Jigsaw++, a novel generative method designed to tackle the multifaceted…
ObjectRIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structures
We introduce RIM-Net, a neural network which learns recursive implicit fields for unsupervised inference of hierarchical shape structures. Our network recursively decomposes an input 3D shape into two parts, resulting in…
DecoderAttention-based Part Assembly for 3D Volumetric Shape Modeling
Modeling a 3D volumetric shape as an assembly of decomposed shape parts is much more challenging, but semantically more valuable than direct reconstruction from a full shape representation. The neural network needs to im…
3D Shape ModelingPQ-NET: A Generative Part Seq2Seq Network for 3D Shapes
We introduce PQ-NET, a deep neural network which represents and generates 3D shapes via sequential part assembly. The input to our network is a 3D shape segmented into parts, where each part is first encoded into a featu…
3D ReconstructionDecoderSingle-View 3D Reconstruction