A Point Cloud Generative Model Based on Nonequilibrium Thermodynamics
We present a probabilistic model for point cloud generation, which is critical for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in non-equilibrium thermodynamics, we view points in point clouds as particles in a thermodynamic system in contact with a heat bath, which diffuse from the original distribution to a noise distribution. Point cloud generation thus amounts to learning the reverse diffusion process that transforms the noise distribution to the distribution of a desired shape. Specifically, we propose to model the reverse diffusion process for point clouds as a Markov chain conditioned on certain shape latent. We derive the variational bound in closed form for training and provide implementations of the model. Experimental results demonstrate that our model achieves the state-of-the-art performance in point cloud generation and auto-encoding.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Stochastic Thermodynamics and SDE-based Generative Models
SDE-based generative models, including diffusion models and the Schrödinger bridge, have found broad applications in signal processing tasks such as speech enhancement, image restoration, and time-series generation. This…
Speech EnhancementImage RestorationSpeed-accuracy relations for diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport
We discuss a connection between a generative model, called the diffusion model, and nonequilibrium thermodynamics for the Fokker-Planck equation, called stochastic thermodynamics. Using techniques from stochastic thermod…
Nonequilibrium thermodynamics of input-driven networks
Neural dynamics of energy-based models are governed by energy minimization and the patterns stored in the network are retrieved when the system reaches equilibrium. However, when the system is driven by time-varying exte…
Nonequilibrium dynamics and thermodynamics provide the underlying physical mechanism of the perceptual rivalry
Perceptual rivalry, where conflicting sensory information leads to alternating perceptions crucial for associated cognitive function, has attracted researcher's attention for long. Despite progresses being made, recent s…
Decision MakingTime SeriesNonequilibrium thermodynamics of self-supervised learning
Self-supervised learning (SSL) of energy based models has an intuitive relation to equilibrium thermodynamics because the softmax layer, mapping energies to probabilities, is a Gibbs distribution. However, in what way SS…
Self-Supervised Learning