PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows
As 3D point clouds become the representation of choice for multiple vision and graphics applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds becomes crucial. Despite the recent success of deep learning models in discriminative tasks of point clouds, generating point clouds remains challenging. This paper proposes a principled probabilistic framework to generate 3D point clouds by modeling them as a distribution of distributions. Specifically, we learn a two-level hierarchy of distributions where the first level is the distribution of shapes and the second level is the distribution of points given a shape. This formulation allows us to both sample shapes and sample an arbitrary number of points from a shape. Our generative model, named PointFlow, learns each level of the distribution with a continuous normalizing flow. The invertibility of normalizing flows enables the computation of the likelihood during training and allows us to train our model in the variational inference framework. Empirically, we demonstrate that PointFlow achieves state-of-the-art performance in point cloud generation. We additionally show that our model can faithfully reconstruct point clouds and learn useful representations in an unsupervised manner. The code will be available at https://github.com/stevenygd/PointFlow.
Code (12)
Tasks
Point Cloud GenerationVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ChartPointFlow for Topology-Aware 3D Point Cloud Generation
A point cloud serves as a representation of the surface of a three-dimensional (3D) shape. Deep generative models have been adapted to model their variations typically using a map from a ball-like set of latent variables…
Point Cloud GenerationSoftFlow: Probabilistic Framework for Normalizing Flow on Manifolds
Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribut…
Point Cloud GenerationFlow Plugin Network for conditional generation
Generative models have gained many researchers' attention in the last years resulting in models such as StyleGAN for human face generation or PointFlow for the 3D point cloud generation. However, by default, we cannot co…
Conditional Image GenerationFace GenerationImage GenerationImage Manipulation+1PointFlowHop: Green and Interpretable Scene Flow Estimation from Consecutive Point Clouds
An efficient 3D scene flow estimation method called PointFlowHop is proposed in this work. PointFlowHop takes two consecutive point clouds and determines the 3D flow vectors for every point in the first point cloud. Poin…
Deep LearningMotion CompensationMotion EstimationScene Flow EstimationEAGLE: Contextual Point Cloud Generation via Adaptive Continuous Normalizing Flow with Self-Attention
As 3D point clouds become the prevailing shape representation in computer vision, how to generate high-resolution point clouds has become a pressing issue. Flow-based generative models can effectively perform point cloud…
Point Cloud Generation