paper-with-me

Papers

Head2HeadFS: Video-based Head Reenactment with Few-shot Learning

2021-03-30 · Michail Christos Doukas, Mohammad Rami Koujan, Viktoriia Sharmanska, Stefanos Zafeiriou

Over the past years, a substantial amount of work has been done on the problem of facial reenactment, with the solutions coming mainly from the graphics community. Head reenactment is an even more challenging task, which aims at transferring not only the facial expression, but also the entire head pose from a source person to a target. Current approaches either train person-specific systems, or use facial landmarks to model human heads, a representation that might transfer unwanted identity attributes from the source to the target. We propose head2headFS, a novel easily adaptable pipeline for head reenactment. We condition synthesis of the target person on dense 3D face shape information from the source, which enables high quality expression and pose transfer. Our video-based rendering network is fine-tuned under a few-shot learning strategy, using only a few samples. This allows for fast adaptation of a generic generator trained on a multiple-person dataset, into a person-specific one.

📄 PDF Abstract BibTeX arXiv:2103.16229

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningPose Transfer

Similar Papers 제목 키워드 기반

VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence

2024-05-25 · Phong Tran, Egor Zakharov, Long-Nhat Ho, Liwen Hu 외

We introduce VOODOO XP: a 3D-aware one-shot head reenactment method that can generate highly expressive facial expressions from any input driver video and a single 2D portrait. Our solution is real-time, view-consistent,…

Disentanglement

One-Shot Face Reenactment on Megapixels

2022-05-26 · Wonjun Kang, Geonsu Lee, Hyung Il Koo, Nam Ik Cho

The goal of face reenactment is to transfer a target expression and head pose to a source face while preserving the source identity. With the popularity of face-related applications, there has been much research on this …

Face GenerationFace ReenactmentFacial EditingTalking Face Generation+1

VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactment

2023-12-07 · CVPR 2024 1 · Phong Tran, Egor Zakharov, Long-Nhat Ho, Anh Tuan Tran 외

We present a 3D-aware one-shot head reenactment method based on a fully volumetric neural disentanglement framework for source appearance and driver expressions. Our method is real-time and produces high-fidelity and vie…

DisentanglementSelf-Supervised Learning

SelfieAvatar: Real-time Head Avatar reenactment from a Selfie Video

2026-01-26 · Wei Liang, Hui Yu, Derui Ding, Rachael E. Jack 외 arxiv

Head avatar reenactment focuses on creating animatable personal avatars from monocular videos, serving as a foundational element for applications like social signal understanding, gaming, human-machine interaction, and c…

Image Generation

DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactment

2024-03-25 · Stella Bounareli, Christos Tzelepis, Vasileios Argyriou, Ioannis Patras 외

Video-driven neural face reenactment aims to synthesize realistic facial images that successfully preserve the identity and appearance of a source face, while transferring the target head pose and facial expressions. Exi…

Face ReenactmentImage Generation