paper-with-me

Papers

Graph-based Normalizing Flow for Human Motion Generation and Reconstruction

2021-04-07 · Wenjie Yin, Hang Yin, Danica Kragic, Mårten Björkman

Data-driven approaches for modeling human skeletal motion have found various applications in interactive media and social robotics. Challenges remain in these fields for generating high-fidelity samples and robustly reconstructing motion from imperfect input data, due to e.g. missed marker detection. In this paper, we propose a probabilistic generative model to synthesize and reconstruct long horizon motion sequences conditioned on past information and control signals, such as the path along which an individual is moving. Our method adapts the existing work MoGlow by introducing a new graph-based model. The model leverages the spatial-temporal graph convolutional network (ST-GCN) to effectively capture the spatial structure and temporal correlation of skeletal motion data at multiple scales. We evaluate the models on a mixture of motion capture datasets of human locomotion with foot-step and bone-length analysis. The results demonstrate the advantages of our model in reconstructing missing markers and achieving comparable results on generating realistic future poses. When the inputs are imperfect, our model shows improvements on robustness of generation.

📄 PDF Abstract BibTeX arXiv:2104.03020

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Generation

Similar Papers 제목 키워드 기반

Semi-Equivariant Conditional Normalizing Flows

2023-04-13 · Eyal Rozenberg, Daniel Freedman

We study the problem of learning conditional distributions of the form $p(G | \hat G)$, where $G$ and $\hat G$ are two 3D graphs, using continuous normalizing flows. We derive a semi-equivariance condition on the flow wh…

FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization

2024-03-11 · CVPR 2024 1 · Shuai Tan, Bin Ji, Ye Pan

Generating emotional talking faces is a practical yet challenging endeavor. To create a lifelike avatar, we draw upon two critical insights from a human perspective: 1) The connection between audio and the non-determinis…

Face GenerationQuantizationTalking Face Generation

Graph Normalizing Flows

2019-05-30 · NeurIPS 2019 12 · Jenny Liu, Aviral Kumar, Jimmy Ba, Jamie Kiros 외

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at …

Graph Neural Network

RecMoDiffuse: Recurrent Flow Diffusion for Human Motion Generation

2024-06-11 · Mirgahney Mohamed, Harry Jake Cunningham, Marc P. Deisenroth, Lourdes Agapito

Human motion generation has paramount importance in computer animation. It is a challenging generative temporal modelling task due to the vast possibilities of human motion, high human sensitivity to motion coherence and…

Motion Generation

Categorical Normalizing Flows via Continuous Transformations

2020-06-17 · ICLR 2021 1 · Phillip Lippe, Efstratios Gavves

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as catego…

DecoderInductive BiasVariational Inference