paper-with-me

홈 › Papers

PhysAnimator: Physics-Guided Generative Cartoon Animation

2025-01-27 · CVPR 2025 1 · Tianyi Xie, Yiwei Zhao, Ying Jiang, Chenfanfu Jiang

Creating hand-drawn animation sequences is labor-intensive and demands professional expertise. We introduce PhysAnimator, a novel approach for generating physically plausible meanwhile anime-stylized animation from static anime illustrations. Our method seamlessly integrates physics-based simulations with data-driven generative models to produce dynamic and visually compelling animations. To capture the fluidity and exaggeration characteristic of anime, we perform image-space deformable body simulations on extracted mesh geometries. We enhance artistic control by introducing customizable energy strokes and incorporating rigging point support, enabling the creation of tailored animation effects such as wind interactions. Finally, we extract and warp sketches from the simulation sequence, generating a texture-agnostic representation, and employ a sketch-guided video diffusion model to synthesize high-quality animation frames. The resulting animations exhibit temporal consistency and visual plausibility, demonstrating the effectiveness of our method in creating dynamic anime-style animations. See our project page for more demos: https://xpandora.github.io/PhysAnimator/

📄 PDF Abstract BibTeX arXiv:2501.16550

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

MagicAnime: A Hierarchically Annotated, Multimodal and Multitasking Dataset with Benchmarks for Cartoon Animation Generation

2025-07-27 · Shuolin Xu, Bingyuan Wang, Zeyu Cai, Fangteng Fu 외 arxiv

Generating high-quality cartoon animations multimodal control is challenging due to the complexity of non-human characters, stylistically diverse motions and fine-grained emotions. There is a huge domain gap between real…

Video Generation

Deep Animation Video Interpolation in the Wild

2021-04-06 · CVPR 2021 1 · Li SiYao, Shiyu Zhao, Weijiang Yu, Wenxiu Sun 외

In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to develop computational models that can automat…

Optical Flow EstimationTripletVideo Frame Interpolation

Instance-guided Cartoon Editing with a Large-scale Dataset

2023-12-04 · Jian Lin, Chengze Li, Xueting Liu, Zhongping Ge

Cartoon editing, appreciated by both professional illustrators and hobbyists, allows extensive creative freedom and the development of original narratives within the cartoon domain. However, the existing literature on ca…

Image SegmentationSegmentationSemantic Segmentation

Sakuga-42M Dataset: Scaling Up Cartoon Research

2024-05-13 · Zhenglin Pan, Yu Zhu, Yuxuan Mu

Hand-drawn cartoon animation employs sketches and flat-color segments to create the illusion of motion. While recent advancements like CLIP, SVD, and Sora show impressive results in understanding and generating natural v…

MambaText to Video RetrievalVideo to Text Retrieval

DanbooRegion: An Illustration Region Dataset

2020-08-01 · ECCV 2020 8 · Lvmin Zhang, Yi JI, Chunping Liu

Region is a fundamental element of various cartoon animation techniques and artistic painting applications. Achieving satisfactory region is essential to the success of these techniques. Motivated to assist diversiform r…