paper-with-me

홈 › Papers

Infinite Motion: Extended Motion Generation via Long Text Instructions

2024-07-11 · Mengtian Li, Chengshuo Zhai, Shengxiang Yao, Zhifeng Xie, Keyu Chen, Yu-Gang Jiang

In the realm of motion generation, the creation of long-duration, high-quality motion sequences remains a significant challenge. This paper presents our groundbreaking work on "Infinite Motion", a novel approach that leverages long text to extended motion generation, effectively bridging the gap between short and long-duration motion synthesis. Our core insight is the strategic extension and reassembly of existing high-quality text-motion datasets, which has led to the creation of a novel benchmark dataset to facilitate the training of models for extended motion sequences. A key innovation of our model is its ability to accept arbitrary lengths of text as input, enabling the generation of motion sequences tailored to specific narratives or scenarios. Furthermore, we incorporate the timestamp design for text which allows precise editing of local segments within the generated sequences, offering unparalleled control and flexibility in motion synthesis. We further demonstrate the versatility and practical utility of "Infinite Motion" through three specific applications: natural language interactive editing, motion sequence editing within long sequences and splicing of independent motion sequences. Each application highlights the adaptability of our approach and broadens the spectrum of possibilities for research and development in motion generation. Through extensive experiments, we demonstrate the superior performance of our model in generating long sequence motions compared to existing methods.Project page: https://shuochengzhai.github.io/Infinite-motion.github.io/

📄 PDF Abstract BibTeX arXiv:2407.08443

Code (0)

등록된 구현이 없습니다.

Tasks

Motion GenerationMotion Synthesis

Similar Papers 제목 키워드 기반

Lagrangian Motion Fields for Long-term Motion Generation

2024-09-03 · Yifei Yang, Zikai Huang, Chenshu Xu, Shengfeng He

Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only s…

Motion GenerationSuperpixels

MotionStream: Real-Time Video Generation with Interactive Motion Controls

2025-11-03 · Joonghyuk Shin, Zhengqi Li, Richard Zhang, Jun-Yan Zhu 외 arxiv

Current motion-conditioned video generation methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present MotionStream, enabling sub-second latency …

Video Generation

InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation

2024-11-27 · Wenjie Zhuo, Fan Ma, Hehe Fan

We present InfiniDreamer, a novel framework for arbitrarily long human motion generation. InfiniDreamer addresses the limitations of current motion generation methods, which are typically restricted to short sequences du…

Motion Generation

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

2024-03-21 · CVPR 2025 1 · Roberto Henschel, Levon Khachatryan, Hayk Poghosyan, Daniil Hayrapetyan 외

Text-to-video diffusion models enable the generation of high-quality videos that follow text instructions, making it easy to create diverse and individual content. However, existing approaches mostly focus on high-qualit…

Text-to-Video GenerationVideo Generation

PipeFlow: Pipelined Processing and Motion-Aware Frame Selection for Long-Form Video Editing

2025-12-30 · Mustafa Munir, Md Mostafijur Rahman, Kartikeya Bhardwaj, Paul Whatmough 외 arxiv

Long-form video editing poses unique challenges due to the exponential increase in the computational cost from joint editing and Denoising Diffusion Implicit Models (DDIM) inversion across extended sequences. To address …