paper-with-me

Papers

Instance-guided Cartoon Editing with a Large-scale Dataset

2023-12-04 · Jian Lin, Chengze Li, Xueting Liu, Zhongping Ge

Cartoon editing, appreciated by both professional illustrators and hobbyists, allows extensive creative freedom and the development of original narratives within the cartoon domain. However, the existing literature on cartoon editing is complex and leans heavily on manual operations, owing to the challenge of automatic identification of individual character instances. Therefore, an automated segmentation of these elements becomes imperative to facilitate a variety of cartoon editing applications such as visual style editing, motion decomposition and transfer, and the computation of stereoscopic depths for an enriched visual experience. Unfortunately, most current segmentation methods are designed for natural photographs, failing to recognize from the intricate aesthetics of cartoon subjects, thus lowering segmentation quality. The major challenge stems from two key shortcomings: the rarity of high-quality cartoon dedicated datasets and the absence of competent models for high-resolution instance extraction on cartoons. To address this, we introduce a high-quality dataset of over 100k paired high-resolution cartoon images and their instance labeling masks. We also present an instance-aware image segmentation model that can generate accurate, high-resolution segmentation masks for characters in cartoon images. We present that the proposed approach enables a range of segmentation-dependent cartoon editing applications like 3D Ken Burns parallax effects, text-guided cartoon style editing, and puppet animation from illustrations and manga.

📄 PDF Abstract BibTeX arXiv:2312.01943

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Deep Sketch-guided Cartoon Video Inbetweening

2020-08-10 · Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

We propose a novel framework to produce cartoon videos by fetching the color information from two input keyframes while following the animated motion guided by a user sketch. The key idea of the proposed approach is to e…

Image GenerationOcclusion Estimation

Interactive Cartoonization with Controllable Perceptual Factors

2022-12-19 · CVPR 2023 1 · Namhyuk Ahn, Patrick Kwon, Jihye Back, Kibeom Hong 외

Cartoonization is a task that renders natural photos into cartoon styles. Previous deep cartoonization methods only have focused on end-to-end translation, which may hinder editability. Instead, we propose a novel soluti…

DecoderTranslation

Sakuga-42M Dataset: Scaling Up Cartoon Research

2024-05-13 · Zhenglin Pan, Yu Zhu, Yuxuan Mu

Hand-drawn cartoon animation employs sketches and flat-color segments to create the illusion of motion. While recent advancements like CLIP, SVD, and Sora show impressive results in understanding and generating natural v…

MambaText to Video RetrievalVideo to Text Retrieval

CartoonRenderer: An Instance-based Multi-Style Cartoon Image Translator

2019-11-14 · Yugang Chen, Muchun Chen, Chaoyue Song, Bingbing Ni

Instance based photo cartoonization is one of the challenging image stylization tasks which aim at transforming realistic photos into cartoon style images while preserving the semantic contents of the photos. State-of-th…

Image Stylization

IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learning

2025-12-17 · Yuanhang Li, Yiren Song, Junzhe Bai, Xinran Liang 외 arxiv

We propose \textbf{IC-Effect}, an instruction-guided, DiT-based framework for few-shot video VFX editing that synthesizes complex effects (\eg flames, particles and cartoon characters) while strictly preserving spatial a…

Instruction Following