paper-with-me

홈 › Papers

Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness

2021-12-11 · CVPR 2022 1 · Jiseob Kim, Jihoon Lee, Byoung-Tak Zhang

Face-swapping models have been drawing attention for their compelling generation quality, but their complex architectures and loss functions often require careful tuning for successful training. We propose a new face-swapping model called `Smooth-Swap', which excludes complex handcrafted designs and allows fast and stable training. The main idea of Smooth-Swap is to build smooth identity embedding that can provide stable gradients for identity change. Unlike the one used in previous models trained for a purely discriminative task, the proposed embedding is trained with a supervised contrastive loss promoting a smoother space. With improved smoothness, Smooth-Swap suffices to be composed of a generic U-Net-based generator and three basic loss functions, a far simpler design compared with the previous models. Extensive experiments on face-swapping benchmarks (FFHQ, FaceForensics++) and face images in the wild show that our model is also quantitatively and qualitatively comparable or even superior to the existing methods.

📄 PDF Abstract BibTeX arXiv:2112.05907

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFace Swapping

Methods 이 논문이 사용한 방법론

Supervised Contrastive Loss 설명 없음

Similar Papers 제목 키워드 기반

ReliableSwap: Boosting General Face Swapping Via Reliable Supervision

2023-06-08 · Ge Yuan, Maomao Li, Yong Zhang, Huicheng Zheng

Almost all advanced face swapping approaches use reconstruction as the proxy task, i.e., supervision only exists when the target and source belong to the same person. Otherwise, lacking pixel-level supervision, these met…

Face ReenactmentFace Swapping

Face Swapping as A Simple Arithmetic Operation

2022-11-19 · Truong Vu, Kien Do, Khang Nguyen, Khoat Than

We propose a novel high-fidelity face swapping method called "Arithmetic Face Swapping" (AFS) that explicitly disentangles the intermediate latent space W+ of a pretrained StyleGAN into the "identity" and "style" subspac…

DisentanglementFace Swapping

Face Transformer: Towards High Fidelity and Accurate Face Swapping

2023-04-05 · Kaiwen Cui, Rongliang Wu, Fangneng Zhan, Shijian Lu

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generati…

Face SwappingVocal Bursts Intensity Prediction

RobustSwap: A Simple yet Robust Face Swapping Model against Attribute Leakage

2023-03-28 · Jaeseong Lee, Taewoo Kim, Sunghyun Park, Younggun Lee 외

Face swapping aims at injecting a source image's identity (i.e., facial features) into a target image, while strictly preserving the target's attributes, which are irrelevant to identity. However, we observed that previo…

AttributeFace Swapping

On Face Segmentation, Face Swapping, and Face Perception

2017-04-22 · Yuval Nirkin, Iacopo Masi, Anh Tuan Tran, Tal Hassner 외

We show that even when face images are unconstrained and arbitrarily paired, face swapping between them is actually quite simple. To this end, we make the following contributions. (a) Instead of tailoring systems for fac…

Face Swapping