Dynamic Deep Multi-task Learning for Caricature-Visual Face Recognition
Rather than the visual images, the face recognition of the caricatures is far from the performance of the visual images. The challenge is the extreme non-rigid distortions of the caricatures introduced by exaggerating the facial features to strengthen the characters. In this paper, we propose dynamic multi-task learning based on deep CNNs for cross-modal caricature-visual face recognition. Instead of the conventional multi-task learning with fixed weights of the tasks, the proposed dynamic multi-task learning dynamically updates the weights of tasks according to the importance of the tasks, which enables the training of the networks focus on the hard task instead of being stuck in the overtraining of the easy task. The experimental results demonstrate the effectiveness of the dynamic multi-task learning for caricature-visual face recognition. The performance evaluated on the datasets CaVI and WebCaricature show the superiority over the state-of-art methods. The implementation code is available here.
Code (1)
Tasks
CaricatureFace RecognitionMulti-Task LearningSimilar Papers 제목 키워드 기반
Cross-modal Multi-task Learning for Graphic Recognition of Caricature Face
Face recognition of realistic visual images has been well studied and made a significant progress in the recent decade. Unlike the realistic visual images, the face recognition of the caricatures is far from the performa…
CaricatureFace RecognitionMulti-Task LearningModeling Caricature Expressions by 3D Blendshape and Dynamic Texture
The problem of deforming an artist-drawn caricature according to a given normal face expression is of interest in applications such as social media, animation and entertainment. This paper presents a solution to the prob…
CaricatureGenerative Adversarial NetworkTexture SynthesisWarpGAN: Automatic Caricature Generation
We propose, WarpGAN, a fully automatic network that can generate caricatures given an input face photo. Besides transferring rich texture styles, WarpGAN learns to automatically predict a set of control points that can w…
Photo-To-Caricature TranslationDeep Cross Modal Learning for Caricature Verification and Identification(CaVINet)
Learning from different modalities is a challenging task. In this paper, we look at the challenging problem of cross modal face verification and recognition between caricature and visual image modalities. Caricature have…
CaricatureFace RecognitionFace VerificationTransfer Learning3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photos
Caricature is a type of artistic style of human faces that attracts considerable attention in the entertainment industry. So far a few 3D caricature generation methods exist and all of them require some caricature inform…
Caricature