Retrieve in Style: Unsupervised Facial Feature Transfer and Retrieval
We present Retrieve in Style (RIS), an unsupervised framework for facial feature transfer and retrieval on real images. Recent work shows capabilities of transferring local facial features by capitalizing on the disentanglement property of the StyleGAN latent space. RIS improves existing art on the following: 1) Introducing more effective feature disentanglement to allow for challenging transfers (ie, hair, pose) that were not shown possible in SoTA methods. 2) Eliminating the need for per-image hyperparameter tuning, and for computing a catalog over a large batch of images. 3) Enabling fine-grained face retrieval using disentangled facial features (eg, eyes). To our best knowledge, this is the first work to retrieve face images at this fine level. 4) Demonstrating robust, natural editing on real images. Our qualitative and quantitative analyses show RIS achieves both high-fidelity feature transfers and accurate fine-grained retrievals on real images. We also discuss the responsible applications of RIS.
Code (1)
Tasks
DisentanglementRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeup
We propose a local adversarial disentangling network (LADN) for facial makeup and de-makeup. Central to our method are multiple and overlapping local adversarial discriminators in a content-style disentangling network fo…
Style TransferVAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer
Current talking face generation methods mainly focus on speech-lip synchronization. However, insufficient investigation on the facial talking style leads to a lifeless and monotonous avatar. Most previous works fail to i…
DecoderFace GenerationStyle TransferTalking Face GenerationTransforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer
Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GS…
SentenceStyle TransferText GenerationText Style Transfer``Transforming'' Delete, Retrieve, Generate Approach for Controlled Text Style Transfer
Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GS…
SentenceStyle TransferText Style TransferRetriever: Learning Content-Style Representation as a Token-Level Bipartite Graph
This paper addresses the unsupervised learning of content-style decomposed representation. We first give a definition of style and then model the content-style representation as a token-level bipartite graph. An unsuperv…
DecoderQuantizationStyle TransferVoice Conversion