paper-with-me

홈 › Papers

GANimator: Neural Motion Synthesis from a Single Sequence

2022-05-05 · Peizhuo Li, Kfir Aberman, Zihan Zhang, Rana Hanocka, Olga Sorkine-Hornung

We present GANimator, a generative model that learns to synthesize novel motions from a single, short motion sequence. GANimator generates motions that resemble the core elements of the original motion, while simultaneously synthesizing novel and diverse movements. Existing data-driven techniques for motion synthesis require a large motion dataset which contains the desired and specific skeletal structure. By contrast, GANimator only requires training on a single motion sequence, enabling novel motion synthesis for a variety of skeletal structures e.g., bipeds, quadropeds, hexapeds, and more. Our framework contains a series of generative and adversarial neural networks, each responsible for generating motions in a specific frame rate. The framework progressively learns to synthesize motion from random noise, enabling hierarchical control over the generated motion content across varying levels of detail. We show a number of applications, including crowd simulation, key-frame editing, style transfer, and interactive control, which all learn from a single input sequence. Code and data for this paper are at https://peizhuoli.github.io/ganimator.

📄 PDF Abstract BibTeX arXiv:2205.02625

Code (1)

PeizhuoLi/ganimator 공식 구현 pytorch

Tasks

Motion SynthesisStyle Transfer

Similar Papers 제목 키워드 기반

Breaking The Limits of Text-conditioned 3D Motion Synthesis with Elaborative Descriptions

2023-01-01 · ICCV 2023 1 · Yijun Qian, Jack Urbanek, Alexander G. Hauptmann, Jungdam Won

Given its wide applications, there is increasing focus on generating 3D human motions from textual descriptions. Differing from the majority of previous works, which regard actions as single entities and can only gen…

AttributeMotion Synthesis

Programmatic Concept Learning for Human Motion Description and Synthesis

2022-06-27 · CVPR 2022 1 · Sumith Kulal, Jiayuan Mao, Alex Aiken, Jiajun Wu

We introduce Programmatic Motion Concepts, a hierarchical motion representation for human actions that captures both low-level motion and high-level description as motion concepts. This representation enables human motio…

MCM: Multi-condition Motion Synthesis Framework

2024-04-19 · Zeyu Ling, Bo Han, Yongkang Wongkan, Han Lin 외

Conditional human motion synthesis (HMS) aims to generate human motion sequences that conform to specific conditions. Text and audio represent the two predominant modalities employed as HMS control conditions. While exis…

Motion Synthesis

Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesis

2026-01-20 · Hongyuan Chen, Xingyu Chen, Youjia Zhang, Zexiang Xu 외 arxiv

We present Motion 3-to-4, a feed-forward framework for synthesising high-quality 4D dynamic objects from a single monocular video and an optional 3D reference mesh. While recent advances have significantly improved 2D, v…

TEACH: Temporal Action Composition for 3D Humans

2022-09-09 · Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol

Given a series of natural language descriptions, our task is to generate 3D human motions that correspond semantically to the text, and follow the temporal order of the instructions. In particular, our goal is to enable …

Motion SynthesisSentence