paper-with-me

홈 › Papers

MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models

2024-12-06 · Tuna Han Salih Meral, Hidir Yesiltepe, Connor Dunlop, Pinar Yanardag

Text-to-video models have demonstrated impressive capabilities in producing diverse and captivating video content, showcasing a notable advancement in generative AI. However, these models generally lack fine-grained control over motion patterns, limiting their practical applicability. We introduce MotionFlow, a novel framework designed for motion transfer in video diffusion models. Our method utilizes cross-attention maps to accurately capture and manipulate spatial and temporal dynamics, enabling seamless motion transfers across various contexts. Our approach does not require training and works on test-time by leveraging the inherent capabilities of pre-trained video diffusion models. In contrast to traditional approaches, which struggle with comprehensive scene changes while maintaining consistent motion, MotionFlow successfully handles such complex transformations through its attention-based mechanism. Our qualitative and quantitative experiments demonstrate that MotionFlow significantly outperforms existing models in both fidelity and versatility even during drastic scene alterations.

📄 PDF Abstract BibTeX arXiv:2412.05275

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

EmotionFlow: Capture the Dialogue Level Emotion Transitions

2022-05-07 · ICASSP 2022 5 · Xiaohui Song, Liangjun Zang, Rong Zhang, Songlin Hu 외

Emotion recognition in conversations (ERC) has attracted increasing interests in recent years, due to its wide range of applications, such as customer service analysis, health-care consultation, etc. One key challenge of…

Emotion RecognitionEmotion Recognition in Conversation

MotionFlow:Learning Implicit Motion Flow for Complex Camera Trajectory Control in Video Generation

2025-09-25 · Guojun Lei, Chi Wang, Yikai Wang, Hong Li 외 arxiv

Generating videos guided by camera trajectories poses significant challenges in achieving consistency and generalizability, particularly when both camera and object motions are present. Existing approaches often attempt …

Video Generation

MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization

2026-01-05 · Zhexin Zhang, Yangyang Xu, Yifeng Zhu, Long Chen 외 arxiv

Recent advances in diffusion-based text-to-video models, particularly those built on the diffusion transformer architecture, have achieved remarkable progress in generating high-quality and temporally coherent videos. Ho…

HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characters

2025-05-26 · Yi Chen, Sen Liang, Zixiang Zhou, Ziyao Huang 외

Recent years have witnessed significant progress in audio-driven human animation. However, critical challenges remain in (i) generating highly dynamic videos while preserving character consistency, (ii) achieving precise…

Human Animation

Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer

2023-11-28 · CVPR 2024 1 · Danah Yatim, Rafail Fridman, Omer Bar-Tal, Yoni Kasten 외

We present a new method for text-driven motion transfer - synthesizing a video that complies with an input text prompt describing the target objects and scene while maintaining an input video's motion and scene layout. P…