PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors
In this paper, we propose a new method for mapping a 3D point cloud to the latent space of a 3D generative adversarial network. Our generative model for 3D point clouds is based on SP-GAN, a state-of-the-art sphere-guided 3D point cloud generator. We derive an efficient way to encode an input 3D point cloud to the latent space of the SP-GAN. Our point cloud encoder can resolve the point ordering issue during inversion, and thus can determine the correspondences between points in the generated 3D point cloud and those in the canonical sphere used by the generator. We show that our method outperforms previous GAN inversion methods for 3D point clouds, achieving state-of-the-art results both quantitatively and qualitatively. Our code is available at https://github.com/hkust-vgd/point_inverter.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkPoint cloud reconstructionSimilar Papers 제목 키워드 기반
Learning Representations and Generative Models for 3D Point Clouds
Three-dimensional geometric data offer an excellent domain for studying representation learning and generative modeling. In this paper, we look at geometric data represented as point clouds. We introduce a deep AutoEncod…
DiversityRepresentation LearningLPMNet: Latent Part Modification and Generation for 3D Point Clouds
In this paper, we focus on latent modification and generation of 3D point cloud object models with respect to their semantic parts. Different to the existing methods which use separate networks for part generation and as…
Frequency-Modulated Point Cloud Rendering with Easy Editing
We develop an effective point cloud rendering pipeline for novel view synthesis, which enables high fidelity local detail reconstruction, real-time rendering and user-friendly editing. In the heart of our pipeline is an …
NeRFNovel View SynthesisSSIMGenerative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification
We propose a generative model of unordered point sets, such as point clouds, in the form of an energy-based model, where the energy function is parameterized by an input-permutation-invariant bottom-up neural network. Th…
3D GenerationGeneral ClassificationPoint Cloud ClassificationPoint Cloud Generation+1SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generation
Denoising diffusion probabilistic models have achieved significant success in point cloud generation, enabling numerous downstream applications, such as generative data augmentation and 3D model editing. However, lit…
3D GenerationData AugmentationDenoisingModel Editing+2