3D Face Arbitrary Style Transfer
Style transfer of 3D faces has gained more and more attention. However, previous methods mainly use images of artistic faces for style transfer while ignoring arbitrary style images such as abstract paintings. To solve this problem, we propose a novel method, namely Face-guided Dual Style Transfer (FDST). To begin with, FDST employs a 3D decoupling module to separate facial geometry and texture. Then we propose a style fusion strategy for facial geometry. Subsequently, we design an optimization-based DDSG mechanism for textures that can guide the style transfer by two style images. Besides the normal style image input, DDSG can utilize the original face input as another style input as the face prior. By this means, high-quality face arbitrary style transfer results can be obtained. Furthermore, FDST can be applied in many downstream tasks, including region-controllable style transfer, high-fidelity face texture reconstruction, large-pose face reconstruction, and artistic face reconstruction. Comprehensive quantitative and qualitative results show that our method can achieve comparable performance. All source codes and pre-trained weights will be released to the public.
Code (0)
등록된 구현이 없습니다.
Tasks
Face ReconstructionStyle TransferSimilar Papers 제목 키워드 기반
RAST: Restorable arbitrary style transfer via multi-restoration
Arbitrary style transfer aims at reproducing the target image with provided artistic or photo-realistic styles. Even though existing approaches can successfully transfer style information, arbitrary style transfer still …
Style Transfer3D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization
Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face.…
3D geometryNeRFStyle TransferLocal Facial Makeup Transfer via Disentangled Representation
Facial makeup transfer aims to render a non-makeup face image in an arbitrary given makeup one while preserving face identity. The most advanced method separates makeup style information from face images to realize makeu…
Facial Makeup TransferDisentangled Makeup Transfer with Generative Adversarial Network
Facial makeup transfer is a widely-used technology that aims to transfer the makeup style from a reference face image to a non-makeup face. Existing literature leverage the adversarial loss so that the generated faces ar…
DecoderFacial Makeup TransferGenerative Adversarial NetworkVirtual Try-onStyle Transfer by Rigid Alignment in Neural Net Feature Space
Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative opti…
Style Transfer