AvatarTex: High-Fidelity Facial Texture Reconstruction from Single-Image Stylized Avatars
We present AvatarTex, a high-fidelity facial texture reconstruction framework capable of generating both stylized and photorealistic textures from a single image. Existing methods struggle with stylized avatars due to the lack of diverse multi-style datasets and challenges in maintaining geometric consistency in non-standard textures. To address these limitations, AvatarTex introduces a novel three-stage diffusion-to-GAN pipeline. Our key insight is that while diffusion models excel at generating diversified textures, they lack explicit UV constraints, whereas GANs provide a well-structured latent space that ensures style and topology consistency. By integrating these strengths, AvatarTex achieves high-quality topology-aligned texture synthesis with both artistic and geometric coherence. Specifically, our three-stage pipeline first completes missing texture regions via diffusion-based inpainting, refines style and structure consistency using GAN-based latent optimization, and enhances fine details through diffusion-based repainting. To address the need for a stylized texture dataset, we introduce TexHub, a high-resolution collection of 20,000 multi-style UV textures with precise UV-aligned layouts. By leveraging TexHub and our structured diffusion-to-GAN pipeline, AvatarTex establishes a new state-of-the-art in multi-style facial texture reconstruction. TexHub will be released upon publication to facilitate future research in this field.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
High-Fidelity Facial Albedo Estimation via Texture Quantization
Recent 3D face reconstruction methods have made significant progress in shape estimation, but high-fidelity facial albedo reconstruction remains challenging. Existing methods depend on expensive light-stage captured data…
3D Face ReconstructionFace ReconstructionQuantizationVGG-Tex: A Vivid Geometry-Guided Facial Texture Estimation Model for High Fidelity Monocular 3D Face Reconstruction
3D face reconstruction from monocular images has promoted the development of various applications such as augmented reality. Though existing methods have made remarkable progress, most of them emphasize geometric reconst…
3D Face ReconstructionFace ReconstructionUV-IDM: Identity-Conditioned Latent Diffusion Model for Face UV-Texture Generation
3D face reconstruction aims at generating high-fidelity 3D face shapes and textures from single-view or multi-view images. However current prevailing facial texture generation methods generally suffer from low-qualit…
3D Face ReconstructionFace ModelFace ReconstructionTexture SynthesisGANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction
In the past few years, a lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the most recent works, d…
3D Face ReconstructionFace ReconstructionGenerative Adversarial NetworkVocal Bursts Intensity PredictionUnsupervised High-Fidelity Facial Texture Generation and Reconstruction
Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scan…
3D geometryImage GenerationTexture SynthesisTransfer Learning+1