paper-with-me

홈 › Papers

Face to Cartoon Incremental Super-Resolution using Knowledge Distillation

2024-01-27 · Trinetra Devkatte, Shiv Ram Dubey, Satish Kumar Singh, Abdenour Hadid

Facial super-resolution/hallucination is an important area of research that seeks to enhance low-resolution facial images for a variety of applications. While Generative Adversarial Networks (GANs) have shown promise in this area, their ability to adapt to new, unseen data remains a challenge. This paper addresses this problem by proposing an incremental super-resolution using GANs with knowledge distillation (ISR-KD) for face to cartoon. Previous research in this area has not investigated incremental learning, which is critical for real-world applications where new data is continually being generated. The proposed ISR-KD aims to develop a novel unified framework for facial super-resolution that can handle different settings, including different types of faces such as cartoon face and various levels of detail. To achieve this, a GAN-based super-resolution network was pre-trained on the CelebA dataset and then incrementally trained on the iCartoonFace dataset, using knowledge distillation to retain performance on the CelebA test set while improving the performance on iCartoonFace test set. Our experiments demonstrate the effectiveness of knowledge distillation in incrementally adding capability to the model for cartoon face super-resolution while retaining the learned knowledge for facial hallucination tasks in GANs.

📄 PDF Abstract BibTeX arXiv:2401.15366

Code (0)

등록된 구현이 없습니다.

Tasks

HallucinationIncremental LearningKnowledge DistillationSuper-Resolution

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Cartoon Face Recognition: A Benchmark Dataset

2019-07-31 · Yi Zheng, Yifan Zhao, Mengyuan Ren, He Yan 외

Recent years have witnessed increasing attention in cartoon media, powered by the strong demands of industrial applications. As the first step to understand this media, cartoon face recognition is a crucial but less-expl…

Domain AdaptationFace DetectionFace RecognitionGeneral Classification+2

ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis

2024-04-21 · Zichen Tang, Hongyu Yang

Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, traini…

3D-Aware Image SynthesisContrastive LearningFace GenerationImage Generation+3

3D Cartoon Face Generation with Controllable Expressions from a Single GAN Image

2022-07-29 · Hao Wang, Wenhao Shen, Guosheng Lin, Steven C. H. Hoi 외

In this paper, we investigate an open research task of generating 3D cartoon face shapes from single 2D GAN generated human faces and without 3D supervision, where we can also manipulate the facial expressions of the 3D …

Face GenerationFace Model

Few-shot Knowledge Transfer for Fine-grained Cartoon Face Generation

2020-07-27 · Nan Zhuang, Cheng Yang

In this paper, we are interested in generating fine-grained cartoon faces for various groups. We assume that one of these groups consists of sufficient training data while the others only contain few samples. Although th…

Face GenerationTransfer LearningTranslation

Instance-guided Cartoon Editing with a Large-scale Dataset

2023-12-04 · Jian Lin, Chengze Li, Xueting Liu, Zhongping Ge

Cartoon editing, appreciated by both professional illustrators and hobbyists, allows extensive creative freedom and the development of original narratives within the cartoon domain. However, the existing literature on ca…

Image SegmentationSegmentationSemantic Segmentation