paper-with-me

Papers

StyleSwap: Style-Based Generator Empowers Robust Face Swapping

2022-09-27 · Zhiliang Xu, Hang Zhou, Zhibin Hong, Ziwei Liu, Jiaming Liu, Zhizhi Guo, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang

Numerous attempts have been made to the task of person-agnostic face swapping given its wide applications. While existing methods mostly rely on tedious network and loss designs, they still struggle in the information balancing between the source and target faces, and tend to produce visible artifacts. In this work, we introduce a concise and effective framework named StyleSwap. Our core idea is to leverage a style-based generator to empower high-fidelity and robust face swapping, thus the generator's advantage can be adopted for optimizing identity similarity. We identify that with only minimal modifications, a StyleGAN2 architecture can successfully handle the desired information from both source and target. Additionally, inspired by the ToRGB layers, a Swapping-Driven Mask Branch is further devised to improve information blending. Furthermore, the advantage of StyleGAN inversion can be adopted. Particularly, a Swapping-Guided ID Inversion strategy is proposed to optimize identity similarity. Extensive experiments validate that our framework generates high-quality face swapping results that outperform state-of-the-art methods both qualitatively and quantitatively.

📄 PDF Abstract BibTeX arXiv:2209.13514

Code (0)

등록된 구현이 없습니다.

Tasks

Face Swapping

Methods 이 논문이 사용한 방법론

HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
StyleGAN 설명 없음
Weight Demodulation 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Path Length Regularization 설명 없음
Adaptive Instance Normalization 설명 없음
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…

Similar Papers 제목 키워드 기반

LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping

2024-02-28 · Changho Choi, Minho Kim, Junhyeok Lee, Hyoung-Kyu Song 외

We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides emplo…

Face Swapping

Face Swapping as A Simple Arithmetic Operation

2022-11-19 · Truong Vu, Kien Do, Khang Nguyen, Khoat Than

We propose a novel high-fidelity face swapping method called "Arithmetic Face Swapping" (AFS) that explicitly disentangles the intermediate latent space W+ of a pretrained StyleGAN into the "identity" and "style" subspac…

DisentanglementFace Swapping

High-Fidelity Face Swapping with Style Blending

2023-12-17 · Xinyu Yang, Hongbo Bo

Face swapping has gained significant traction, driven by the plethora of human face synthesis facilitated by deep learning methods. However, previous face swapping methods that used generative adversarial networks (GANs)…

DecoderFace GenerationFace Swapping

Fine-Grained Face Swapping via Regional GAN Inversion

2022-11-25 · CVPR 2023 1 · Zhian Liu, Maomao Li, Yong Zhang, Cairong Wang 외

We present a novel paradigm for high-fidelity face swapping that faithfully preserves the desired subtle geometry and texture details. We rethink face swapping from the perspective of fine-grained face editing, \textit{i…

DisentanglementFace Swapping

StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping

2023-01-01 · CVPR 2023 1 · Diqiong Jiang, Dan Song, Ruofeng Tong, Min Tang

Recent researches reveal that StyleGAN can generate highly realistic images, inspiring researchers to use pretrained StyleGAN to generate high-fidelity swapped faces. However, existing methods fail to meet the expect…

AttributeFace Swapping