ImDy: Human Inverse Dynamics from Imitated Observations

2024-10-23 · Xinpeng Liu, Junxuan Liang, Zili Lin, Haowen Hou, Yong-Lu Li, Cewu Lu

Inverse dynamics (ID), which aims at reproducing the driven torques from human kinematic observations, has been a critical tool for gait analysis. However, it is hindered from wider application to general motion due to its limited scalability. Conventional optimization-based ID requires expensive laboratory setups, restricting its availability. To alleviate this problem, we propose to exploit the recently progressive human motion imitation algorithms to learn human inverse dynamics in a data-driven manner. The key insight is that the human ID knowledge is implicitly possessed by motion imitators, though not directly applicable. In light of this, we devise an efficient data collection pipeline with state-of-the-art motion imitation algorithms and physics simulators, resulting in a large-scale human inverse dynamics benchmark as Imitated Dynamics (ImDy). ImDy contains over 150 hours of motion with joint torque and full-body ground reaction force data. With ImDy, we train a data-driven human inverse dynamics solver ImDyS(olver) in a fully supervised manner, which conducts ID and ground reaction force estimation simultaneously. Experiments on ImDy and real-world data demonstrate the impressive competency of ImDyS in human inverse dynamics and ground reaction force estimation. Moreover, the potential of ImDy(-S) as a fundamental motion analysis tool is exhibited with downstream applications. The project page is https://foruck.github.io/ImDy/.

📄 PDF Abstract BibTeX arXiv:2410.17610

Code (0)

등록된 구현이 없습니다.

Policy Continuation with Hindsight Inverse Dynamics

2019-10-30 · NeurIPS 2019 12 · Hao Sun, Zhizhong Li, Xiaotong Liu, Dahua Lin 외

Solving goal-oriented tasks is an important but challenging problem in reinforcement learning (RL). For such tasks, the rewards are often sparse, making it difficult to learn a policy effectively. To tackle this difficul…

Reinforcement Learning Reinforcement Learning (RL)

Spectro-Temporal Modulation Representation Framework for Human-Imitated Speech Detection

2026-04-25 · Khalid Zaman, Masashi Unoki arxiv

Human-imitated speech poses a greater challenge than AI-generated speech for both human listeners and automatic detection systems. Unlike AI-generated speech, which often contains artifacts, over-smoothed spectra, or rob…

Human Imitated Bipedal Locomotion with Frequency Based Gait Generator Network

2025-11-21 · Yusuf Baran Ates, Omer Morgul arxiv

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proxi…

Reinforcement Learning

CLOUD: Contrastive Learning of Unsupervised Dynamics

2020-10-23 · Jianren Wang, Yujie Lu, Hang Zhao

Developing agents that can perform complex control tasks from high dimensional observations such as pixels is challenging due to difficulties in learning dynamics efficiently. In this work, we propose to learn forward an…

Contrastive Learning

Human-Like Active Learning: Machines Simulating the Human Learning Process

2020-11-07 · Jaeseo Lim, Hwiyeol Jo, Byoung-Tak Zhang, Jooyong Park

Although the use of active learning to increase learners' engagement has recently been introduced in a variety of methods, empirical experiments are lacking. In this study, we attempted to align two experiments in order …

Active Learning Form Knowledge Distillation