paper-with-me

홈 › Papers

FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation

2026-09-27 · Yiyi Cai, Yuhan Wu, Kunhang Li, Tu Fangyuan, Xiangyue Zhang, Qiaoge Li, Zhixiang Wang, Kaipeng Zhang, Haiyang Liu arxiv

We present FloodDiffusion 2 (FD2), an efficient and controllable framework that builds upon FloodDiffusion (FD1), a state-of-the-art streaming motion generation model. While FD1 produces plausible motion, it suffers from low efficiency and limited controllability, as its attention design requires repeated computation over the entire history, and it lacks precise trajectory control for real-world applications. To address these limitations and improve generation quality, FD2 introduces three advances. First, Partial Attention makes finalized history representations independent of the active window, enabling KV-cached inference and shared-history packing for efficient training. Second, we establish a necessary-and-sufficient Bregman criterion for regression losses to preserve diffusion's conditional-mean velocity field. This criterion guides an FK-induced quadratic loss that incorporates motion geometry without online FK evaluation. Third, FD2 introduces precise path conditioning to control the character's root trajectory while preserving natural body motion. Experiments show that FD2 reduces training computation by 4.6$\times$ and accelerates denoising by 11.29$\times$, reaching 2.303 ms per update on long sequences. Alongside these efficiency gains, FD2 improves motion quality over FD1 and achieves state-of-the-art FID scores among streaming methods, with 0.048 on SEED and 0.053 on HumanML3D.

📄 PDF Abstract BibTeX arXiv:2609.33167

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generation

2025-12-03 · Yiyi Cai, Yuhan Wu, Kunhang Li, You Zhou 외 arxiv

We present FloodDiffusion, a new framework for text-driven, streaming human motion generation. Given time-varying text prompts, FloodDiffusion generates text-aligned, seamless motion sequences with real-time latency. Unl…

4DStreamCtrl: Interactive Video Generation with Online 4D Control

2026-08-26 · Shiqian Li, Chenguo Lin, Zhiguang Liu, Yu Tang 외 arxiv

Generative video models now synthesize footage nearly indistinguishable from reality. Their promise as interactive tools hinges on fine-grained control of how objects and the camera move over time, yet each existing appr…

Video GenerationCausal Inference

ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation

2026-07-09 · Kaifeng Zhao, Mathis Petrovich, Haotian Zhang, Tingwu Wang 외 arxiv

Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics. While recent offline motion generation approaches offer precise control via text…

Streaming Video Generation with Streaming Force Control

2026-06-05 · Hanhui Wang, Yiming Xie, Haiwen Feng, Zhaoyang Lv 외 arxiv

We introduce StreamForce, a streaming video generation framework that enables physically grounded control through continuous force inputs. Unlike prior video models that train separate models for different force types, a…

Video Generation

OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model

2025-07-07 · Chen Wang, Tianyu Peng, Wen Yang, Yinan Bai 외 arxiv

Empathetic interaction is a cornerstone of human-machine communication, due to the need for understanding speech enriched with paralinguistic cues and generating emotional and expressive responses. However, the most powe…