3D Magic Mirror: Automatic Video to 3D Caricature Translation
Caricature is an abstraction of a real person which distorts or exaggerates certain features, but still retains a likeness. While most existing works focus on 3D caricature reconstruction from 2D caricatures or translating 2D photos to 2D caricatures, this paper presents a real-time and automatic algorithm for creating expressive 3D caricatures with caricature style texture map from 2D photos or videos. To solve this challenging ill-posed reconstruction problem and cross-domain translation problem, we first reconstruct the 3D face shape for each frame, and then translate 3D face shape from normal style to caricature style by a novel identity and expression preserving VAE-CycleGAN. Based on a labeling formulation, the caricature texture map is constructed from a set of multi-view caricature images generated by CariGANs. The effectiveness and efficiency of our method are demonstrated by comparison with baseline implementations. The perceptual study shows that the 3D caricatures generated by our method meet people's expectations of 3D caricature style.
Code (0)
등록된 구현이 없습니다.
Tasks
CaricatureTranslationSimilar Papers 제목 키워드 기반
Magic Mirror: ID-Preserved Video Generation in Video Diffusion Transformers
We present Magic Mirror, a framework for generating identity-preserved videos with cinematic-level quality and dynamic motion. While recent advances in video diffusion models have shown impressive capabilities in text-to…
DiversityText-to-Video GenerationVideo GenerationUnsupervised Contrastive Photo-to-Caricature Translation based on Auto-distortion
Photo-to-caricature translation aims to synthesize the caricature as a rendered image exaggerating the features through sketching, pencil strokes, or other artistic drawings. Style rendering and geometry deformation are …
CaricaturePhoto-To-Caricature TranslationTranslationCariGANs: Unpaired Photo-to-Caricature Translation
Facial caricature is an art form of drawing faces in an exaggerated way to convey humor or sarcasm. In this paper, we propose the first Generative Adversarial Network (GAN) for unpaired photo-to-caricature translation, w…
CaricatureGenerative Adversarial NetworkPhoto-To-Caricature TranslationTranslationCariMe: Unpaired Caricature Generation with Multiple Exaggerations
Caricature generation aims to translate real photos into caricatures with artistic styles and shape exaggerations while maintaining the identity of the subject. Different from the generic image-to-image translation, draw…
CaricatureImage-to-Image TranslationWarpGAN: Automatic Caricature Generation
We propose, WarpGAN, a fully automatic network that can generate caricatures given an input face photo. Besides transferring rich texture styles, WarpGAN learns to automatically predict a set of control points that can w…
Photo-To-Caricature Translation