paper-with-me

Papers

ShapeEditer: a StyleGAN Encoder for Face Swapping

2021-06-26 · Shuai Yang, Kai Qiao

In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced pretrained high-quality random face image generator, i.e. StyleGAN, as backbone. Secondly, we design ShapeEditor, a two-step encoder, to make the swapped face integrate the identity and attribute of the input faces. In the first step, we extract the identity vector of the source image and the attribute vector of the target image respectively; in the second step, we map the concatenation of identity vector and attribute vector into the $\mathcal{W+}$ potential space. In addition, for learning to map into the latent space of StyleGAN, we propose a set of self-supervised loss functions with which the training data do not need to be labeled manually. Extensive experiments on the test dataset show that the results of our method not only have a great advantage in clarity and authenticity than other state-of-the-art methods, but also reflect the sufficient integration of identity and attribute.

📄 PDF Abstract BibTeX arXiv:2106.13984

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeFace Swapping

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Adaptive Instance Normalization 설명 없음
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…

Similar Papers 제목 키워드 기반

End-to-end Face-swapping via Adaptive Latent Representation Learning

2023-03-07 · Chenhao Lin, Pengbin Hu, Chao Shen, Qian Li

Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blendi…

AttributeFace SwappingRepresentation LearningStyle Transfer

ExtSwap: Leveraging Extended Latent Mapper for Generating High Quality Face Swapping

2023-10-19 · Aravinda Reddy PN, K. Sreenivasa Rao, Raghavendra Ramachandra, Pabitra Mitra

We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quali…

AttributeDecoderFace Swapping

StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping

2023-01-01 · CVPR 2023 1 · Diqiong Jiang, Dan Song, Ruofeng Tong, Min Tang

Recent researches reveal that StyleGAN can generate highly realistic images, inspiring researchers to use pretrained StyleGAN to generate high-fidelity swapped faces. However, existing methods fail to meet the expect…

AttributeFace Swapping

StyleSwap: Style-Based Generator Empowers Robust Face Swapping

2022-09-27 · Zhiliang Xu, Hang Zhou, Zhibin Hong, Ziwei Liu 외

Numerous attempts have been made to the task of person-agnostic face swapping given its wide applications. While existing methods mostly rely on tedious network and loss designs, they still struggle in the information ba…

Face Swapping

Fine-Grained Face Swapping via Regional GAN Inversion

2022-11-25 · CVPR 2023 1 · Zhian Liu, Maomao Li, Yong Zhang, Cairong Wang 외

We present a novel paradigm for high-fidelity face swapping that faithfully preserves the desired subtle geometry and texture details. We rethink face swapping from the perspective of fine-grained face editing, \textit{i…

DisentanglementFace Swapping