Single Source One Shot Reenactment using Weighted motion From Paired Feature Points
Image reenactment is a task where the target object in the source image imitates the motion represented in the driving image. One of the most common reenactment tasks is face image animation. The major challenge in the current face reenactment approaches is to distinguish between facial motion and identity. For this reason, the previous models struggle to produce high-quality animations if the driving and source identities are different (cross-person reenactment). We propose a new (face) reenactment model that learns shape-independent motion features in a self-supervised setup. The motion is represented using a set of paired feature points extracted from the source and driving images simultaneously. The model is generalised to multiple reenactment tasks including faces and non-face objects using only a single source image. The extensive experiments show that the model faithfully transfers the driving motion to the source while retaining the source identity intact.
Code (0)
등록된 구현이 없습니다.
Tasks
Face ReenactmentImage AnimationSimilar Papers 제목 키워드 기반
Mesh Guided One-shot Face Reenactment using Graph Convolutional Networks
Face reenactment aims to animate a source face image to a different pose and expression provided by a driving image. Existing approaches are either designed for a specific identity, or suffer from the identity preservati…
DecoderFace GenerationFace ReenactmentMotion Estimation+1FACEGAN: Facial Attribute Controllable rEenactment GAN
The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by co…
AttributeFace ReenactmentLearning Dense Correspondence for NeRF-Based Face Reenactment
Face reenactment is challenging due to the need to establish dense correspondence between various face representations for motion transfer. Recent studies have utilized Neural Radiance Field (NeRF) as fundamental represe…
Face ReenactmentNeRFToonTalker: Cross-Domain Face Reenactment
We target cross-domain face reenactment in this paper, i.e., driving a cartoon image with the video of a real person and vice versa. Recently, many works have focused on one-shot talking face generation to drive a portra…
Face GenerationFace ReenactmentTalking Face GenerationOne-Shot Identity-Preserving Portrait Reenactment
We present a deep learning-based framework for portrait reenactment from a single picture of a target (one-shot) and a video of a driving subject. Existing facial reenactment methods suffer from identity mismatch and pro…
DisentanglementGenerative Adversarial Network