DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusion
While the community of 3D point cloud generation has witnessed a big growth in recent years, there still lacks an effective way to enable intuitive user control in the generation process, hence limiting the general utility of such methods. Since an intuitive way of decomposing a shape is through its parts, we propose to tackle the task of controllable part-based point cloud generation. We introduce DiffFacto, a novel probabilistic generative model that learns the distribution of shapes with part-level control. We propose a factorization that models independent part style and part configuration distributions and presents a novel cross-diffusion network that enables us to generate coherent and plausible shapes under our proposed factorization. Experiments show that our method is able to generate novel shapes with multiple axes of control. It achieves state-of-the-art part-level generation quality and generates plausible and coherent shapes while enabling various downstream editing applications such as shape interpolation, mixing, and transformation editing. Project website: https://difffacto.github.io/
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generation
Denoising diffusion probabilistic models have achieved significant success in point cloud generation, enabling numerous downstream applications, such as generative data augmentation and 3D model editing. However, lit…
3D GenerationData AugmentationDenoisingModel Editing+2StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer
In the field of 3D point cloud generation, numerous 3D generative models have demonstrated the ability to generate diverse and realistic 3D shapes. However, the majority of these approaches struggle to generate controlla…
Point Cloud GenerationPoint CloudsP2M2-Net: Part-Aware Prompt-Guided Multimodal Point Cloud Completion
Inferring missing regions from severely occluded point clouds is highly challenging. Especially for 3D shapes with rich geometry and structure details, inherent ambiguities of the unknown parts are existing. Existing app…
Point Cloud CompletionEditVAE: Unsupervised Part-Aware Controllable 3D Point Cloud Shape Generation
This paper tackles the problem of parts-aware point cloud generation. Unlike existing works which require the point cloud to be segmented into parts a priori, our parts-aware editing and generation are performed in an un…
Inductive BiasPoint Cloud GenerationPoints-to-3D: Structure-Aware 3D Generation with Point Cloud Priors
Recent progress in 3D generation has been driven largely by models conditioned on images or text, while readily available 3D priors are still underused. In many real-world scenarios, the visible-region point cloud are ea…
Scene Generation3D GenerationPoint Clouds