paper-with-me

Papers

Single Source One Shot Reenactment using Weighted motion From Paired Feature Points

2021-04-07 · Soumya Tripathy, Juho Kannala, Esa Rahtu

Image reenactment is a task where the target object in the source image imitates the motion represented in the driving image. One of the most common reenactment tasks is face image animation. The major challenge in the current face reenactment approaches is to distinguish between facial motion and identity. For this reason, the previous models struggle to produce high-quality animations if the driving and source identities are different (cross-person reenactment). We propose a new (face) reenactment model that learns shape-independent motion features in a self-supervised setup. The motion is represented using a set of paired feature points extracted from the source and driving images simultaneously. The model is generalised to multiple reenactment tasks including faces and non-face objects using only a single source image. The extensive experiments show that the model faithfully transfers the driving motion to the source while retaining the source identity intact.

📄 PDF Abstract BibTeX arXiv:2104.03117

Code (0)

등록된 구현이 없습니다.

Tasks

Face ReenactmentImage Animation

Similar Papers 제목 키워드 기반

Mesh Guided One-shot Face Reenactment using Graph Convolutional Networks

2020-08-18 · Guangming Yao, Yi Yuan, Tianjia Shao, Kun Zhou

Face reenactment aims to animate a source face image to a different pose and expression provided by a driving image. Existing approaches are either designed for a specific identity, or suffer from the identity preservati…

DecoderFace GenerationFace ReenactmentMotion Estimation+1

FACEGAN: Facial Attribute Controllable rEenactment GAN

2020-11-09 · Soumya Tripathy, Juho Kannala, Esa Rahtu

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by co…

AttributeFace Reenactment

Learning Dense Correspondence for NeRF-Based Face Reenactment

2023-12-16 · Songlin Yang, Wei Wang, Yushi Lan, Xiangyu Fan 외

Face reenactment is challenging due to the need to establish dense correspondence between various face representations for motion transfer. Recent studies have utilized Neural Radiance Field (NeRF) as fundamental represe…

Face ReenactmentNeRF

ToonTalker: Cross-Domain Face Reenactment

2023-08-24 · ICCV 2023 1 · Yuan Gong, Yong Zhang, Xiaodong Cun, Fei Yin 외

We target cross-domain face reenactment in this paper, i.e., driving a cartoon image with the video of a real person and vice versa. Recently, many works have focused on one-shot talking face generation to drive a portra…

Face GenerationFace ReenactmentTalking Face Generation

One-Shot Identity-Preserving Portrait Reenactment

2020-04-26 · Sitao Xiang, Yuming Gu, Pengda Xiang, Mingming He 외

We present a deep learning-based framework for portrait reenactment from a single picture of a target (one-shot) and a video of a driving subject. Existing facial reenactment methods suffer from identity mismatch and pro…

DisentanglementGenerative Adversarial Network