Style-based Point Generator with Adversarial Rendering for Point Cloud Completion
In this paper, we proposed a novel Style-based Point Generator with Adversarial Rendering (SpareNet) for point cloud completion. Firstly, we present the channel-attentive EdgeConv to fully exploit the local structures as well as the global shape in point features. Secondly, we observe that the concatenation manner used by vanilla foldings limits its potential of generating a complex and faithful shape. Enlightened by the success of StyleGAN, we regard the shape feature as style code that modulates the normalization layers during the folding, which considerably enhances its capability. Thirdly, we realize that existing point supervisions, e.g., Chamfer Distance or Earth Mover's Distance, cannot faithfully reflect the perceptual quality of the reconstructed points. To address this, we propose to project the completed points to depth maps with a differentiable renderer and apply adversarial training to advocate the perceptual realism under different viewpoints. Comprehensive experiments on ShapeNet and KITTI prove the effectiveness of our method, which achieves state-of-the-art quantitative performance while offering superior visual quality.
Code (1)
Tasks
Point Cloud CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Frequency-Aware Patch Adversarial Learning for Neural Point Cloud Rendering
We present a neural point cloud rendering pipeline through a novel multi-frequency-aware patch adversarial learning framework. The proposed approach aims to improve the rendering realness by minimizing the spectrum discr…
HairNeRF: Geometry-Aware Image Synthesis for Hairstyle Transfer
We propose a novel hairstyle transferred image synthesis method considering the underlying head geometry of two input images. In traditional GAN-based methods, transferring hairstyle from one image to the other often…
Image GenerationNeural RenderingFreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifold
Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provi…
3D ReconstructionMixed RealityNovel View SynthesisMAPGN: MAsked Pointer-Generator Network for sequence-to-sequence pre-training
This paper presents a self-supervised learning method for pointer-generator networks to improve spoken-text normalization. Spoken-text normalization that converts spoken-style text into style normalized text is becoming …
Machine TranslationSelf-Supervised LearningText NormalizationGated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer
Style transfer describes the rendering of an image semantic content as different artistic styles. Recently, generative adversarial networks (GANs) have emerged as an effective approach in style transfer by adversarially …
DecoderStyle Transfer