paper-with-me

Papers

ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation

2025-12-08 · Ziyang Mai, Yu-Wing Tai arxiv

Text-to-video (T2V) generation has advanced rapidly, yet maintaining consistent character identities across scenes remains a major challenge. Existing personalization methods often focus on facial identity but fail to preserve broader contextual cues such as hairstyle, outfit, and body shape, which are critical for visual coherence. We propose \textbf{ContextAnyone}, a context-aware diffusion framework that achieves character-consistent video generation from text and a single reference image. Our method jointly reconstructs the reference image and generates new video frames, enabling the model to fully perceive and utilize reference information. Reference information is effectively integrated into a DiT-based diffusion backbone through a novel Emphasize-Attention module that selectively reinforces reference-aware features and prevents identity drift across frames. A dual-guidance loss combines diffusion and reference reconstruction objectives to enhance appearance fidelity, while the proposed Gap-RoPE positional embedding separates reference and video tokens to stabilize temporal modeling. Experiments demonstrate that ContextAnyone outperforms existing reference-to-video methods in identity consistency and visual quality, generating coherent and context-preserving character videos across diverse motions and scenes. Project page: \href{https://github.com/ziyang1106/ContextAnyone}{https://github.com/ziyang1106/ContextAnyone}.

📄 PDF Abstract BibTeX arXiv:2512.07328

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Video Generation

Similar Papers 제목 키워드 기반

TaleDiffusion: Multi-Character Story Generation with Dialogue Rendering

2025-09-04 · Ayan Banerjee, Josep Llados, Umapada Pal, Anjan Dutta arxiv

Text-to-story visualization is challenging due to the need for consistent interaction among multiple characters across frames. Existing methods struggle with character consistency, leading to artifact generation and inac…

Story VisualizationStory Generation

TextPixs: Glyph-Conditioned Diffusion with Character-Aware Attention and OCR-Guided Supervision

2025-07-08 · Syeda Anshrah Gillani, Mirza Samad Ahmed Baig, Osama Ahmed Khan, Shahid Munir Shah 외

The modern text-to-image diffusion models boom has opened a new era in digital content production as it has proven the previously unseen ability to produce photorealistic and stylistically diverse imagery based on the se…

Image GenerationOptical Character Recognition (OCR)

CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models

2024-04-24 · Qinghe Wang, Baolu Li, Xiaomin Li, Bing Cao 외

Recent advances in text-to-image models have opened new frontiers in human-centric generation. However, these models cannot be directly employed to generate images with consistent newly coined identities. In this work, w…

Consistent Character GenerationWord Embeddings

DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior

2026-04-19 · Junjia Huang, Binbin Yang, Pengxiang Yan, Jiyang Liu 외 arxiv

Storyboard synthesis plays a crucial role in visual storytelling, aiming to generate coherent shot sequences that visually narrate cinematic events with consistent characters, scenes, and transitions. However, existing a…

Visual StorytellingStory Continuation

AnimeAdapter: A Modular Adapter for Appearance-Consistent Anime Character Generation

2026-05-17 · Yixuan Han arxiv

We present a lightweight appearance adapter for Stable Diffusion that enables controllable and consistent anime character generation under diverse editing conditions. Instead of relying on large-scale vision-language mod…