paper-with-me

홈 › Papers

Implicit Neural Representations for Variable Length Human Motion Generation

2022-03-25 · Pablo Cervantes, Yusuke Sekikawa, Ikuro Sato, Koichi Shinoda

We propose an action-conditional human motion generation method using variational implicit neural representations (INR). The variational formalism enables action-conditional distributions of INRs, from which one can easily sample representations to generate novel human motion sequences. Our method offers variable-length sequence generation by construction because a part of INR is optimized for a whole sequence of arbitrary length with temporal embeddings. In contrast, previous works reported difficulties with modeling variable-length sequences. We confirm that our method with a Transformer decoder outperforms all relevant methods on HumanAct12, NTU-RGBD, and UESTC datasets in terms of realism and diversity of generated motions. Surprisingly, even our method with an MLP decoder consistently outperforms the state-of-the-art Transformer-based auto-encoder. In particular, we show that variable-length motions generated by our method are better than fixed-length motions generated by the state-of-the-art method in terms of realism and diversity. Code at https://github.com/PACerv/ImplicitMotion.

📄 PDF Abstract BibTeX arXiv:2203.13694

Code (1)

pacerv/implicitmotion 공식 구현 pytorch

Tasks

DecoderDiversityMotion Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Length-Aware Motion Synthesis via Latent Diffusion

2024-07-16 · Alessio Sampieri, Alessio Palma, Indro Spinelli, Fabio Galasso

The target duration of a synthesized human motion is a critical attribute that requires modeling control over the motion dynamics and style. Speeding up an action performance is not merely fast-forwarding it. However, st…

AttributeMotion Synthesis

ALIEN: Implicit Neural Representations for Human Motion Prediction under Arbitrary Latency

2025-01-01 · CVPR 2025 1 · Dong Wei, Xiaoning Sun, Xizhan Gao, Shengxiang Hu 외

We investigate a new task in human motion prediction, which aims to forecast future body poses from historically observed sequences while accounting for arbitrary latency. This differs from existing works that assume…

Human motion predictionMambamotion predictionMulti-Task Learning+1

Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations

2023-03-23 · Quanzhou Li, Jingbo Wang, Chen Change Loy, Bo Dai

Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling h…

Human-Object Interaction DetectionMotion EstimationMotion SynthesisObject

BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generation

2026-02-21 · Miaowei Wang, Qingxuan Yan, Zhi Cao, Yayuan Li 외 arxiv

Text-guided dynamic 3D character generation has advanced rapidly, yet producing high-quality motion that faithfully reflects rich textual descriptions remains challenging. Existing methods tend to generate limited sub-ac…

MUGL: Large Scale Multi Person Conditional Action Generation with Locomotion

2021-10-21 · Shubh Maheshwari, Debtanu Gupta, Ravi Kiran Sarvadevabhatla

We introduce MUGL, a novel deep neural model for large-scale, diverse generation of single and multi-person pose-based action sequences with locomotion. Our controllable approach enables variable-length generations custo…

Action GenerationDiversityHuman action generation