HyperPocket: Generative Point Cloud Completion
Scanning real-life scenes with modern registration devices typically give incomplete point cloud representations, mostly due to the limitations of the scanning process and 3D occlusions. Therefore, completing such partial representations remains a fundamental challenge of many computer vision applications. Most of the existing approaches aim to solve this problem by learning to reconstruct individual 3D objects in a synthetic setup of an uncluttered environment, which is far from a real-life scenario. In this work, we reformulate the problem of point cloud completion into an object hallucination task. Thus, we introduce a novel autoencoder-based architecture called HyperPocket that disentangles latent representations and, as a result, enables the generation of multiple variants of the completed 3D point clouds. We split point cloud processing into two disjoint data streams and leverage a hypernetwork paradigm to fill the spaces, dubbed pockets, that are left by the missing object parts. As a result, the generated point clouds are not only smooth but also plausible and geometrically consistent with the scene. Our method offers competitive performances to the other state-of-the-art models, and it enables a~plethora of novel applications.
Code (1)
Tasks
HallucinationObject HallucinationPoint Cloud CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DualGenerator: Information Interaction-based Generative Network for Point Cloud Completion
Point cloud completion estimates complete shapes from incomplete point clouds to obtain higher-quality point cloud data. Most existing methods only consider global object features, ignoring spatial and semantic informati…
Point Cloud CompletionMedPCFM: Improving Medical Point Cloud Completion by Integrating Point Transformers and Flow Matching
Medical point cloud completion is important for anatomical reconstruction and downstream clinical workflows, yet generative modeling in this setting remains insufficiently studied. We investigate completion through conti…
Point Cloud CompletionComprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysis
Point cloud completion is a generation and estimation issue derived from the partial point clouds, which plays a vital role in the applications in 3D computer vision. The progress of deep learning (DL) has impressively i…
Point Cloud CompletionSurveyGenPC: Zero-shot Point Cloud Completion via 3D Generative Priors
Existing point cloud completion methods, which typically depend on predefined synthetic training datasets, encounter significant challenges when applied to out-of-distribution, real-world scans. To overcome this limitati…
3D GenerationImage to 3DPoint Cloud CompletionEnergy-Based Residual Latent Transport for Unsupervised Point Cloud Completion
Unsupervised point cloud completion aims to infer the whole geometry of a partial object observation without requiring partial-complete correspondence. Differing from existing deterministic approaches, we advocate genera…
DecoderPoint Cloud Completion