paper-with-me

홈 › Papers

DeepPhase: Periodic Autoencoders for Learning Motion Phase Manifolds

2022-07-22 · ACM Transactions on Graphics 2022 7 · Sebastian Starke, Ian Mason, Taku Komura

Learning the spatial-temporal structure of body movements is a fundamental problem for character motion synthesis. In this work, we propose a novel neural network architecture called the Periodic Autoencoder that can learn periodic features from large unstructured motion datasets in an unsupervised manner. The character movements are decomposed into multiple latent channels that capture the non-linear periodicity of different body segments while progressing forward in time. Our method extracts a multi-dimensional phase space from full-body motion data, which effectively clusters animations and produces a manifold in which computed feature distances provide a better similarity measure than in the original motion space to achieve better temporal and spatial alignment. We demonstrate that the learned periodic embedding can significantly help to improve neural motion synthesis in a number of tasks, including diverse locomotion skills, style-based movements, dance motion synthesis from music, synthesis of dribbling motions in football, and motion query for matching poses within large animation databases.

📄 PDF Abstract BibTeX

Code (1)

sebastianstarke/AI4Animation tf

Tasks

Motion Synthesis

Similar Papers 제목 키워드 기반

FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds

2025-12-10 · Marco Pegoraro, Evan Atherton, Bruno Roy, Aliasghar Khani 외 arxiv

Learning natural body motion remains challenging due to the strong coupling between spatial geometry and temporal dynamics. Embedding motion in phase manifolds, latent spaces that capture local periodicity, has proven ef…

WalkTheDog: Cross-Morphology Motion Alignment via Phase Manifolds

2024-07-11 · SIGGRAPH 2024 7 · Peizhuo Li, Sebastian Starke, Yuting Ye, Olga Sorkine-Hornung

We present a new approach for understanding the periodicity structure and semantics of motion datasets, independently of the morphology and skeletal structure of characters. Unlike existing methods using an overly sparse…

Retrieval

Towards Unified Co-Speech Gesture Generation via Hierarchical Implicit Periodicity Learning

2025-12-15 · Xin Guo, Yifan Zhao, Jia Li arxiv

Generating 3D-based body movements from speech shows great potential in extensive downstream applications, while it still suffers challenges in imitating realistic human movements. Predominant research efforts focus on e…

Gesture Generation

Motion In-Betweening with Phase Manifolds

2023-08-24 · Paul Starke, Sebastian Starke, Taku Komura, Frank Steinicke

This paper introduces a novel data-driven motion in-betweening system to reach target poses of characters by making use of phases variables learned by a Periodic Autoencoder. Our approach utilizes a mixture-of-experts ne…

Mixture-of-Expertsmotion in-betweening

DeepPhase: Surgical Phase Recognition in CATARACTS Videos

2018-07-17 · Zisimopoulos Odysseas, Flouty Evangello, Luengo Imanol, Giataganas Petros 외

Automated surgical workflow analysis and understanding can assist surgeons to standardize procedures and enhance post-surgical assessment and indexing, as well as, interventional monitoring. Computer-assisted interventio…

Surgical phase recognitionSurgical tool detection