SMooDi: Stylized Motion Diffusion Model
We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized motion driven by content texts and style motion sequences. Unlike existing methods that either generate motion of various content or transfer style from one sequence to another, SMooDi can rapidly generate motion across a broad range of content and diverse styles. To this end, we tailor a pre-trained text-to-motion model for stylization. Specifically, we propose style guidance to ensure that the generated motion closely matches the reference style, alongside a lightweight style adaptor that directs the motion towards the desired style while ensuring realism. Experiments across various applications demonstrate that our proposed framework outperforms existing methods in stylized motion generation.
Code (0)
등록된 구현이 없습니다.
Tasks
modelMotion GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sketch-Guided Motion Diffusion for Stylized Cinemagraph Synthesis
Designing stylized cinemagraphs is challenging due to the difficulty in customizing complex and expressive flow motions. To achieve intuitive and detailed control of the generated cinemagraphs, freehand sketches can prov…
object-detectionObject DetectionGenerative Motion Stylization of Cross-structure Characters within Canonical Motion Space
Stylized motion breathes life into characters. However, the fixed skeleton structure and style representation hinder existing data-driven motion synthesis methods from generating stylized motion for various characters. I…
Motion SynthesisSMooGPT: Stylized Motion Generation using Large Language Models
Stylized motion generation is actively studied in computer graphics, especially benefiting from the rapid advances in diffusion models. The goal of this task is to produce a novel motion respecting both the motion conten…
Style TransferStyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion
We present StyleMotif, a novel Stylized Motion Latent Diffusion model, generating motion conditioned on both content and style from multiple modalities. Unlike existing approaches that either focus on generating diverse …
Motion GenerationMotion SynthesisAniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models
Animating stylized avatars with dynamic poses and expressions has attracted increasing attention for its broad range of applications. Previous research has made significant progress by training controllable generative mo…
Image Animation