Towards Implicit Text-Guided 3D Shape Generation
In this work, we explore the challenging task of generating 3D shapes from text. Beyond the existing works, we propose a new approach for text-guided 3D shape generation, capable of producing high-fidelity shapes with colors that match the given text description. This work has several technical contributions. First, we decouple the shape and color predictions for learning features in both texts and shapes, and propose the word-level spatial transformer to correlate word features from text with spatial features from shape. Also, we design a cyclic loss to encourage consistency between text and shape, and introduce the shape IMLE to diversify the generated shapes. Further, we extend the framework to enable text-guided shape manipulation. Extensive experiments on the largest existing text-shape benchmark manifest the superiority of this work. The code and the models are available at https://github.com/liuzhengzhe/Towards-Implicit Text-Guided-Shape-Generation.
Code (1)
Tasks
3D Shape GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation
This paper presents a new text-guided technique for generating 3D shapes. The technique leverages a hybrid 3D shape representation, namely EXIM, combining the strengths of explicit and implicit representations. Specifica…
3D Shape Generation3D Shape RepresentationText-guided Image-and-Shape Editing and Generation: A Short Survey
Image and shape editing are ubiquitous among digital artworks. Graphics algorithms facilitate artists and designers to achieve desired editing intents without going through manually tedious retouching. In the recent adva…
SurveySP-GAN: Sphere-Guided 3D Shape Generation and Manipulation
We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds. Compared with existing models, SP-GAN is able to synthesize diverse and high-quality sha…
3D Shape GenerationGeometry-guided Emotion Modulation for Controllable and Photorealistic Emotional Talking Face Generation
Audio-driven emotional talking face generation aims to synthesize realistic videos with expressive facial dynamics. However, existing methods struggle to balance controllability and visual fidelity. Although implicit rep…
Talking Face GenerationContinuous Control3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models
Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel rep…
3D Generation3D Shape GenerationDecoderDiversity+3