Region-Aware Face Swapping

2022-03-09 · CVPR 2022 1 · Chao Xu, Jiangning Zhang, Miao Hua, Qian He, Zili Yi, Yong liu

This paper presents a novel Region-Aware Face Swapping (RAFSwap) network to achieve identity-consistent harmonious high-resolution face generation in a local-global manner: \textbf{1)} Local Facial Region-Aware (FRA) branch augments local identity-relevant features by introducing the Transformer to effectively model misaligned cross-scale semantic interaction. \textbf{2)} Global Source Feature-Adaptive (SFA) branch further complements global identity-relevant cues for generating identity-consistent swapped faces. Besides, we propose a \textit{Face Mask Predictor} (FMP) module incorporated with StyleGAN2 to predict identity-relevant soft facial masks in an unsupervised manner that is more practical for generating harmonious high-resolution faces. Abundant experiments qualitatively and quantitatively demonstrate the superiority of our method for generating more identity-consistent high-resolution swapped faces over SOTA methods, \eg, obtaining 96.70 ID retrieval that outperforms SOTA MegaFS by 5.87$\uparrow$.

📄 PDF Abstract BibTeX arXiv:2203.04564

Code (0)

등록된 구현이 없습니다.

Tasks

Face GenerationFace Swapping Retrieval

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Adam 설명 없음

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

FSNet: An Identity-Aware Generative Model for Image-based Face Swapping

2018-11-30 · Ryota Natsume, Tatsuya Yatagawa, Shigeo Morishima

This paper presents FSNet, a deep generative model for image-based face swapping. Traditionally, face-swapping methods are based on three-dimensional morphable models (3DMMs), and facial textures are replaced between the…

Face Swapping

Face Transformer: Towards High Fidelity and Accurate Face Swapping

2023-04-05 · Kaiwen Cui, Rongliang Wu, Fangneng Zhan, Shijian Lu

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generati…

Face Swapping Vocal Bursts Intensity Prediction

FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping

2019-12-31 · Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen 외

In this work, we propose a novel two-stage framework, called FaceShifter, for high fidelity and occlusion aware face swapping. Unlike many existing face swapping works that leverage only limited information from the targ…

Face Generation Face Swapping Vocal Bursts Intensity Prediction

Advancing High Fidelity Identity Swapping for Forgery Detection

2020-06-01 · CVPR 2020 6 · Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen 외

In this work, we study various existing benchmarks for deepfake detection researches. In particular, we examine a novel two-stage face swapping algorithm, called FaceShifter, for high fidelity and occlusion aware face sw…

DeepFake Detection Face Swapping Vocal Bursts Intensity Prediction

Fine-Grained Face Swapping via Regional GAN Inversion

2022-11-25 · CVPR 2023 1 · Zhian Liu, Maomao Li, Yong Zhang, Cairong Wang 외

We present a novel paradigm for high-fidelity face swapping that faithfully preserves the desired subtle geometry and texture details. We rethink face swapping from the perspective of fine-grained face editing, \textit{i…

Disentanglement Face Swapping