paper-with-me

홈 › Papers

Character Mixing for Video Generation

2025-10-06 · Tingting Liao, Chongjian Ge, Guangyi Liu, Hao Li, Yi Zhou arxiv

Imagine Mr. Bean stepping into Tom and Jerry--can we generate videos where characters interact naturally across different worlds? We study inter-character interaction in text-to-video generation, where the key challenge is to preserve each character's identity and behaviors while enabling coherent cross-context interaction. This is difficult because characters may never have coexisted and because mixing styles often causes style delusion, where realistic characters appear cartoonish or vice versa. We introduce a framework that tackles these issues with Cross-Character Embedding (CCE), which learns identity and behavioral logic across multimodal sources, and Cross-Character Augmentation (CCA), which enriches training with synthetic co-existence and mixed-style data. Together, these techniques allow natural interactions between previously uncoexistent characters without losing stylistic fidelity. Experiments on a curated benchmark of cartoons and live-action series with 10 characters show clear improvements in identity preservation, interaction quality, and robustness to style delusion, enabling new forms of generative storytelling.Additional results and videos are available on our project page: https://tingtingliao.github.io/mimix/.

📄 PDF Abstract BibTeX arXiv:2510.05093

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Video Generation

Similar Papers 제목 키워드 기반

Hear What Matters! Text-conditioned Selective Video-to-Audio Generation

2025-12-02 · Junwon Lee, Juhan Nam, Jiyoung Lee arxiv

This work introduces a new task, text-conditioned selective video-to-audio (V2A) generation, which produces only the user-intended sound from a multi-object video. This capability is especially crucial in multimedia prod…

Audio Generation

Representation Mixing for TTS Synthesis

2018-11-17 · Kyle Kastner, João Felipe Santos, Yoshua Bengio, Aaron Courville

Recent character and phoneme-based parametric TTS systems using deep learning have shown strong performance in natural speech generation. However, the choice between character or phoneme input can create serious limitati…

Semantic visually-guided acoustic highlighting with large vision-language models

2026-01-12 · Junhua Huang, Chao Huang, Chenliang Xu arxiv

Balancing dialogue, music, and sound effects with accompanying video is crucial for immersive storytelling, yet current audio mixing workflows remain largely manual and labor-intensive. While recent advancements have int…

SRNeRV: A Scale-wise Recursive Framework for Neural Video Representation

2026-03-09 · Jia Wang, Jun Zhu, Xinfeng Zhang arxiv

Implicit Neural Representations (INRs) have emerged as a promising paradigm for video representation and compression. However, existing multi-scale INR generators often suffer from significant parameter redundancy by sta…

Vi-MIX FOR SELF-SUPERVISED VIDEO REPRESENTATION

2021-09-29 · Srijan Das, Michael S Ryoo

Contrastive representation learning of videos highly rely on exhaustive data aug- mentation strategies. Therefore, towards designing video augmentation for self- supervised learning, we first analyze the best strategy to…

Action RecognitionRepresentation LearningRetrievalSelf-Supervised Learning+1