paper-with-me

Papers

Learning Disentangled Representation for One-shot Progressive Face Swapping

2022-03-24 · Qi Li, Weining Wang, Chengzhong Xu, Zhenan Sun, Ming-Hsuan Yang

Although face swapping has attracted much attention in recent years, it remains a challenging problem. Existing methods leverage a large number of data samples to explore the intrinsic properties of face swapping without considering the semantic information of face images. Moreover, the representation of the identity information tends to be fixed, leading to suboptimal face swapping. In this paper, we present a simple yet efficient method named FaceSwapper, for one-shot face swapping based on Generative Adversarial Networks. Our method consists of a disentangled representation module and a semantic-guided fusion module. The disentangled representation module comprises an attribute encoder and an identity encoder, which aims to achieve the disentanglement of the identity and attribute information. The identity encoder is more flexible, and the attribute encoder contains more attribute details than its competitors. Benefiting from the disentangled representation, FaceSwapper can swap face images progressively. In addition, semantic information is introduced into the semantic-guided fusion module to control the swapped region and model the pose and expression more accurately. Experimental results show that our method achieves state-of-the-art results on benchmark datasets with fewer training samples. Our code is publicly available at https://github.com/liqi-casia/FaceSwapper.

📄 PDF Abstract BibTeX arXiv:2203.12985

Code (1)

liqi-casia/faceswapper 공식 구현 pytorch

Tasks

AttributeDisentanglementFace Swapping

Similar Papers 제목 키워드 기반

High-resolution Face Swapping via Latent Semantics Disentanglement

2022-03-30 · CVPR 2022 1 · Yangyang Xu, Bailin Deng, Junle Wang, Yanqing Jing 외

We present a novel high-resolution face swapping method using the inherent prior knowledge of a pre-trained GAN model. Although previous research can leverage generative priors to produce high-resolution results, their q…

DisentanglementFace SwappingHallucinationVocal Bursts Intensity Prediction

Information Bottleneck Disentanglement for Identity Swapping

2021-06-19 · CVPR 2021 1 · Gege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li 외

Improving the performance of face forgery detectors often requires more identity-swapped images of higher-quality. One core objective of identity swapping is to generate identity-discriminative faces that are distinc…

DisentanglementFace RecognitionImage Manipulation

3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces

2021-11-24 · CVPR 2022 1 · Simone Foti, Bongjin Koo, Danail Stoyanov, Matthew J. Clarkson

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is …

Disentanglement

One Shot Face Swapping on Megapixels

2021-05-11 · CVPR 2021 1 · Yuhao Zhu, Qi Li, Jian Wang, Chengzhong Xu 외

Face swapping has both positive applications such as entertainment, human-computer interaction, etc., and negative applications such as DeepFake threats to politics, economics, etc. Nevertheless, it is necessary to under…

DeepFake DetectionDisentanglementFace SwappingFace Transfer+1

ExtSwap: Leveraging Extended Latent Mapper for Generating High Quality Face Swapping

2023-10-19 · Aravinda Reddy PN, K. Sreenivasa Rao, Raghavendra Ramachandra, Pabitra Mitra

We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quali…

AttributeDecoderFace Swapping