Comprehensive Facial Expression Synthesis using Human-Interpretable Language
Recent advances in facial expression synthesis have shown promising results using diverse expression representations including facial action units. Facial action units for an elaborate facial expression synthesis need to be intuitively represented for human comprehension, not a numeric categorization of facial action units. To address this issue, we utilize human-friendly approach: use of natural language where language helps human grasp conceptual contexts. In this paper, therefore, we propose a new facial expression synthesis model from language-based facial expression description. Our method can synthesize the facial image with detailed expressions. In addition, effectively embedding language features on facial features, our method can control individual word to handle each part of facial movement. Extensive qualitative and quantitative evaluations were conducted to verify the effectiveness of the natural language.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Photo-Realistic Facial Details Synthesis from Single Image
We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation a…
Face GenerationEmo3D: Metric and Benchmarking Dataset for 3D Facial Expression Generation from Emotion Description
Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of huma…
BenchmarkingFacial expression generationDriving Animatronic Robot Facial Expression From Speech
Animatronic robots hold the promise of enabling natural human-robot interaction through lifelike facial expressions. However, generating realistic, speech-synchronized robot expressions poses significant challenges due t…
Motion GenerationMotion SynthesisPhotorealistic Facial Expression Synthesis by the Conditional Difference Adversarial Autoencoder
Photorealistic facial expression synthesis from single face image can be widely applied to face recognition, data augmentation for emotion recognition or entertainment. This problem is challenging, in part due to a pauci…
Data AugmentationDecoderEmotion RecognitionFace RecognitionCLIPER: A Unified Vision-Language Framework for In-the-Wild Facial Expression Recognition
Facial expression recognition (FER) is an essential task for understanding human behaviors. As one of the most informative behaviors of humans, facial expressions are often compound and variable, which is manifested by t…
Dynamic Facial Expression RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)