paper-with-me

홈 › Papers

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

2021-10-10 · Haichao Zhang, Youcheng Ben, Weixi Zhang, Tao Chen, Gang Yu, Bin Fu

Recent face reenactment works are limited by the coarse reference landmarks, leading to unsatisfactory identity preserving performance due to the distribution gap between the manipulated landmarks and those sampled from a real person. To address this issue, we propose a fine-grained identity-preserving landmark-guided face reenactment approach. The proposed method has two novelties. First, a landmark synthesis network which is designed to generate fine-grained landmark faces with more details. The network refines the manipulated landmarks and generates a smooth and gradually changing face landmark sequence with good identity preserving ability. Second, several novel loss functions including synthesized face identity preserving loss, foreground/background mask loss as well as boundary loss are designed, which aims at synthesizing clear and sharp high-quality faces. Experiments are conducted on our self-collected BeautySelfie and the public VoxCeleb1 datasets. The presented qualitative and quantitative results show that our method can reenact fine-grained higher quality faces with good ID-preserved appearance details, fewer artifacts and clearer boundaries than state-of-the-art works. Code will be released for reproduction.

📄 PDF Abstract BibTeX arXiv:2110.04708

Code (0)

등록된 구현이 없습니다.

Tasks

Face Reenactment

Similar Papers 제목 키워드 기반

LaTo: Landmark-tokenized Diffusion Transformer for Fine-grained Human Face Editing

2025-09-30 · Zhenghao Zhang, Ziying Zhang, Junchao Liao, Xiangyu Meng 외 arxiv

Recent multimodal models for instruction-based face editing enable semantic manipulation but still struggle with precise attribute control and identity preservation. Structural facial representations such as landmarks ar…

Identity-Preserving Realistic Talking Face Generation

2020-05-25 · Sanjana Sinha, Sandika Biswas, Brojeshwar Bhowmick

Speech-driven facial animation is useful for a variety of applications such as telepresence, chatbots, etc. The necessary attributes of having a realistic face animation are 1) audio-visual synchronization (2) identity p…

Audio-Visual SynchronizationFace GenerationImage ReconstructionTalking Face Generation

Identity-Preserving Talking Face Generation with Landmark and Appearance Priors

2023-05-15 · CVPR 2023 1 · Weizhi Zhong, Chaowei Fang, Yinqi Cai, Pengxu Wei 외

Generating talking face videos from audio attracts lots of research interest. A few person-specific methods can generate vivid videos but require the target speaker's videos for training or fine-tuning. Existing person-g…

Face GenerationTalking Face Generation

RealTalk: Realistic Emotion-Aware Lifelike Talking-Head Synthesis

2025-08-16 · Wenqing Wang, Yun Fu arxiv

Emotion is a critical component of artificial social intelligence. However, while current methods excel in lip synchronization and image quality, they often fail to generate accurate and controllable emotional expression…

Face Anonymization Made Simple

2024-11-01 · Han-Wei Kung, Tuomas Varanka, Sanjay Saha, Terence Sim 외

Current face anonymization techniques often depend on identity loss calculated by face recognition models, which can be inaccurate and unreliable. Additionally, many methods require supplementary data such as facial land…

AttributeFace AnonymizationFace RecognitionFace Swapping