Synthesizing Human Faces using Latent Space Factorization and Local Weights (Extended Version)
We propose a 3D face generative model with local weights to increase the model's variations and expressiveness. The proposed model allows partial manipulation of the face while still learning the whole face mesh. For this purpose, we address an effective way to extract local facial features from the entire data and explore a way to manipulate them during a holistic generation. First, we factorize the latent space of the whole face to the subspace indicating different parts of the face. In addition, local weights generated by non-negative matrix factorization are applied to the factorized latent space so that the decomposed part space is semantically meaningful. We experiment with our model and observe that effective facial part manipulation is possible and that the model's expressiveness is improved.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Closed-Form Factorization of Latent Semantics in GANs
A rich set of interpretable dimensions has been shown to emerge in the latent space of the Generative Adversarial Networks (GANs) trained for synthesizing images. In order to identify such latent dimensions for image edi…
AttributeFormImage GenerationImage ManipulationImage-to-Image Translation with Disentangled Latent Vectors for Face Editing
We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with con…
AttributeDecoderDisentanglementImage-to-Image Translation+1VecGAN: Image-to-Image Translation with Interpretable Latent Directions
We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controlla…
AttributeImage-to-Image TranslationTranslationNarrating For You: Prompt-guided Audio-visual Narrating Face Generation Employing Multi-entangled Latent Space
We present a novel approach for generating realistic speaking and talking faces by synthesizing a person's voice and facial movements from a static image, a voice profile, and a target text. The model encodes the prompt/…
Video GenerationGANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesis
Generative Adversarial Networks (GANs) are capable of synthesizing high-quality facial images. Despite their success, GANs do not provide any information about the relationship between the input vectors and the generated…
AttributeFace GenerationImage Generation