paper-with-me

Papers

Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer

2026-03-01 · Yuze Li, Dong Gong, Xiao Cao, Junchao Yuan, Dongsheng Li, Lei Zhou, Yun Sing Koh, Cheng Yan, Xinyu Zhang arxiv

Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple objects require distinct motion patterns. In this work, we present FlexiMMT, the first implicit image-to-video (I2V) motion transfer framework that explicitly enables multi-object, multi-motion transfer. Given a static multi-object image and multiple reference videos, FlexiMMT independently extracts motion representations and accurately assigns them to different objects, supporting flexible recombination and arbitrary motion-to-object mappings. To address the core challenge of cross-object motion entanglement, we introduce a Motion Decoupled Mask Attention Mechanism that uses object-specific masks to constrain attention, ensuring that motion and text tokens only influence their designated regions. We further propose a Differentiated Mask Propagation Mechanism that derives object-specific masks directly from diffusion attention and progressively propagates them across frames efficiently. Extensive experiments demonstrate that FlexiMMT achieves precise, compositional, and state-of-the-art performance in I2V-based multi-object multi-motion transfer. Our project page is: https://ethan-li123.github.io/FlexiMMT_page/

📄 PDF Abstract BibTeX arXiv:2603.01000

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts

2024-03-13 · Yue Ma, Yingqing He, Hongfa Wang, Andong Wang 외

Despite recent advances in image-to-video generation, better controllability and local animation are less explored. Most existing image-to-video methods are not locally aware and tend to move the entire scene. However, h…

Image AnimationImage to Video GenerationVideo Generation

Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editing

2024-05-07 · Yi Zuo, Lingling Li, Licheng Jiao, Fang Liu 외

Existing diffusion-based methods have achieved impressive results in human motion editing. However, these methods often exhibit significant ghosting and body distortion in unseen in-the-wild cases. In this paper, we intr…

ObjectVideo Editing

Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation

2024-06-04 · Yue Ma, Hongyu Liu, Hongfa Wang, Heng Pan 외

We present Follow-Your-Emoji, a diffusion-based framework for portrait animation, which animates a reference portrait with target landmark sequences. The main challenge of portrait animation is to preserve the identity o…

Portrait Animation

Turing Test for the Internet of Things

2014-12-11 · Neil Rubens

How smart is your kettle? How smart are things in your kitchen, your house, your neighborhood, on the internet? With the advent of Internet of Things, and the move of making devices `smart' by utilizing AI, a natural que…

Dance Your Latents: Consistent Dance Generation through Spatial-temporal Subspace Attention Guided by Motion Flow

2023-10-20 · Haipeng Fang, Zhihao Sun, Ziyao Huang, Fan Tang 외

The advancement of generative AI has extended to the realm of Human Dance Generation, demonstrating superior generative capacities. However, current methods still exhibit deficiencies in achieving spatiotemporal consiste…