paper-with-me

Papers

Face Swapping as A Simple Arithmetic Operation

2022-11-19 · Truong Vu, Kien Do, Khang Nguyen, Khoat Than

We propose a novel high-fidelity face swapping method called "Arithmetic Face Swapping" (AFS) that explicitly disentangles the intermediate latent space W+ of a pretrained StyleGAN into the "identity" and "style" subspaces so that a latent code in W+ is the sum of an "identity" code and a "style" code in the corresponding subspaces. Via our disentanglement, face swapping (FS) can be regarded as a simple arithmetic operation in W+, i.e., the summation of a source "identity" code and a target "style" code. This makes AFS more intuitive and elegant than other FS methods. In addition, our method can generalize over the standard face swapping to support other interesting operations, e.g., combining the identity of one source with styles of multiple targets and vice versa. We implement our identity-style disentanglement by learning a neural network that maps a latent code to a "style" code. We provide a condition for this network which theoretically guarantees identity preservation of the source face even after a sequence of face swapping operations. Extensive experiments demonstrate the advantage of our method over state-of-the-art FS methods in producing high-quality swapped faces. Our source code was made public at https://github.com/truongvu2000nd/AFS

📄 PDF Abstract BibTeX arXiv:2211.10812

Code (1)

truongvu2000nd/afs 공식 구현 pytorch

Tasks

DisentanglementFace Swapping

Methods 이 논문이 사용한 방법론

HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
StyleGAN 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
Adaptive Instance Normalization 설명 없음
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swapping

2023-06-22 · Yu Zhang, Hao Zeng, Bowen Ma, Wei zhang 외

This work proposes a novel face-swapping framework FlowFace++, utilizing explicit semantic flow supervision and end-to-end architecture to facilitate shape-aware face-swapping. Specifically, our work pretrains a facial s…

DecoderFace Swapping

FaceOff: A Video-to-Video Face Swapping System

2022-08-21 · Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay, Vinay Namboodiri 외

Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The double's face is later replaced with the…

Face Swapping

Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness

2021-12-11 · CVPR 2022 1 · Jiseob Kim, Jihoon Lee, Byoung-Tak Zhang

Face-swapping models have been drawing attention for their compelling generation quality, but their complex architectures and loss functions often require careful tuning for successful training. We propose a new face-swa…

Contrastive LearningFace Swapping

On Face Segmentation, Face Swapping, and Face Perception

2017-04-22 · Yuval Nirkin, Iacopo Masi, Anh Tuan Tran, Tal Hassner 외

We show that even when face images are unconstrained and arbitrarily paired, face swapping between them is actually quite simple. To this end, we make the following contributions. (a) Instead of tailoring systems for fac…

Face Swapping

RobustSwap: A Simple yet Robust Face Swapping Model against Attribute Leakage

2023-03-28 · Jaeseong Lee, Taewoo Kim, Sunghyun Park, Younggun Lee 외

Face swapping aims at injecting a source image's identity (i.e., facial features) into a target image, while strictly preserving the target's attributes, which are irrelevant to identity. However, we observed that previo…

AttributeFace Swapping