Learning to Cartoonize Using White-Box Cartoon Representations
This paper presents an approach for image cartoonization. By observing the cartoon painting behavior and consulting artists, we propose to separately identify three white-box representations from images: the surface representation that contains smooth surface of cartoon images, the structure representation that refers to the sparse color-blocks and flatten global content in the celluloid style workflow, and the texture representation that reflects high-frequency texture, contours and details in cartoon images. A Generative Adversarial Network (GAN) framework is used to learn the extracted representations and to cartoonize images. The learning objectives of our method are separately based on each extracted representations, making our framework controllable and adjustable. This enables our approach to meet artists' requirements in different styles and diverse use cases. Qualitative comparisons and quantitative analyses, as well as user studies, have been conducted to validate the effectiveness of this approach, and our method outperforms previous methods in all comparisons. Finally, the ablation study demonstrates the influence of each component in our framework.
Code (2)
Tasks
Generative Adversarial NetworkReal-to-Cartoon translationSimilar Papers 제목 키워드 기반
cGANs for Cartoon to Real-life Images
The image-to-image translation is a learning task to establish a visual mapping between an input and output image. The task has several variations differentiated based on the purpose of the translation, such as synthetic…
CaricatureGenerative Adversarial NetworkImage-to-Image TranslationPhoto-To-Caricature Translation+2Null-text Guidance in Diffusion Models is Secretly a Cartoon-style Creator
Classifier-free guidance is an effective sampling technique in diffusion models that has been widely adopted. The main idea is to extrapolate the model in the direction of text guidance and away from null-text guidance. …
White-Box Cartoonization Using An Extended GAN Framework
In the present study, we propose to implement a new framework for estimating generative models via an adversarial process to extend an existing GAN framework and develop a white-box controllable image cartoonization, whi…
Generative Adversarial NetworkArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis
Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, traini…
3D-Aware Image SynthesisContrastive LearningFace GenerationImage Generation+3Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks
Recently, realistic image generation using deep neural networks has become a hot topic in machine learning and computer vision. Images can be generated at the pixel level by learning from a large collection of images. Le…
Image Generation