paper-with-me

홈 › Papers

3D Face Arbitrary Style Transfer

2023-03-14 · Xiangwen Deng, Yingshuang Zou, Yuanhao Cai, Chendong Zhao, Yang Liu, Zhifang Liu, Yuxiao Liu, Jiawei Zhou, Haoqian Wang

Style transfer of 3D faces has gained more and more attention. However, previous methods mainly use images of artistic faces for style transfer while ignoring arbitrary style images such as abstract paintings. To solve this problem, we propose a novel method, namely Face-guided Dual Style Transfer (FDST). To begin with, FDST employs a 3D decoupling module to separate facial geometry and texture. Then we propose a style fusion strategy for facial geometry. Subsequently, we design an optimization-based DDSG mechanism for textures that can guide the style transfer by two style images. Besides the normal style image input, DDSG can utilize the original face input as another style input as the face prior. By this means, high-quality face arbitrary style transfer results can be obtained. Furthermore, FDST can be applied in many downstream tasks, including region-controllable style transfer, high-fidelity face texture reconstruction, large-pose face reconstruction, and artistic face reconstruction. Comprehensive quantitative and qualitative results show that our method can achieve comparable performance. All source codes and pre-trained weights will be released to the public.

📄 PDF Abstract BibTeX arXiv:2303.07709

Code (0)

등록된 구현이 없습니다.

Tasks

Face ReconstructionStyle Transfer

Similar Papers 제목 키워드 기반

RAST: Restorable arbitrary style transfer via multi-restoration

2023-12-31 · Conference 2023 12 · Yingnan Ma, Chenqiu Zhao, Xudong Li, Anup Basu

Arbitrary style transfer aims at reproducing the target image with provided artistic or photo-realistic styles. Even though existing approaches can successfully transfer style information, arbitrary style transfer still …

Style Transfer

3D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization

2023-11-22 · Jianwei Feng, Prateek Singhal

Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face.…

3D geometryNeRFStyle Transfer

Local Facial Makeup Transfer via Disentangled Representation

2020-03-27 · Zhaoyang Sun, Wenxuan Liu, Feng Liu, Ryan Wen Liu 외

Facial makeup transfer aims to render a non-makeup face image in an arbitrary given makeup one while preserving face identity. The most advanced method separates makeup style information from face images to realize makeu…

Facial Makeup Transfer

Disentangled Makeup Transfer with Generative Adversarial Network

2019-07-02 · Honglun Zhang, Wenqing Chen, Hao He, Yaohui Jin

Facial makeup transfer is a widely-used technology that aims to transfer the makeup style from a reference face image to a non-makeup face. Existing literature leverage the adversarial loss so that the generated faces ar…

DecoderFacial Makeup TransferGenerative Adversarial NetworkVirtual Try-on

Style Transfer by Rigid Alignment in Neural Net Feature Space

2019-09-27 · Suryabhan Singh Hada, Miguel Á. Carreira-Perpiñán

Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative opti…

Style Transfer