EditVAE: Unsupervised Part-Aware Controllable 3D Point Cloud Shape Generation
This paper tackles the problem of parts-aware point cloud generation. Unlike existing works which require the point cloud to be segmented into parts a priori, our parts-aware editing and generation are performed in an unsupervised manner. We achieve this with a simple modification of the Variational Auto-Encoder which yields a joint model of the point cloud itself along with a schematic representation of it as a combination of shape primitives. In particular, we introduce a latent representation of the point cloud which can be decomposed into a disentangled representation for each part of the shape. These parts are in turn disentangled into both a shape primitive and a point cloud representation, along with a standardising transformation to a canonical coordinate system. The dependencies between our standardising transformations preserve the spatial dependencies between the parts in a manner that allows meaningful parts-aware point cloud generation and shape editing. In addition to the flexibility afforded by our disentangled representation, the inductive bias introduced by our joint modeling approach yields state-of-the-art experimental results on the ShapeNet dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Inductive BiasPoint Cloud GenerationSimilar Papers 제목 키워드 기반
Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Clouds
The point cloud representation of an object can have a large geometric variation in view of inconsistent data acquisition procedure, which thus leads to domain discrepancy due to diverse and uncontrollable shape represen…
Domain AdaptationPoint Cloud ClassificationRepresentation LearningUnsupervised Domain AdaptationGeometry-Aware Self-Training for Unsupervised Domain Adaptation on Object Point Clouds
The point cloud representation of an object can have a large geometric variation in view of inconsistent data acquisition procedure, which thus leads to domain discrepancy due to diverse and uncontrollable shape repr…
Domain AdaptationPoint Cloud ClassificationRepresentation LearningUnsupervised Domain AdaptationVeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis
Unsupervised learning of 3D-aware generative adversarial networks has lately made much progress. Some recent work demonstrates promising results of learning human generative models using neural articulated radiance field…
Image GenerationDisentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning
In recent years, more and more attention has been paid to the learning of 3D human representation. However, the complexity of lots of hand-defined human body constraints and the absence of supervision data limit that the…
DisentanglementPose TransferStrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer
In the field of 3D point cloud generation, numerous 3D generative models have demonstrated the ability to generate diverse and realistic 3D shapes. However, the majority of these approaches struggle to generate controlla…
Point Cloud GenerationPoint Clouds