paper-with-me

홈 › Papers

DiffMimic: Efficient Motion Mimicking with Differentiable Physics

2023-04-06 · Jiawei Ren, Cunjun Yu, Siwei Chen, Xiao Ma, Liang Pan, Ziwei Liu

Motion mimicking is a foundational task in physics-based character animation. However, most existing motion mimicking methods are built upon reinforcement learning (RL) and suffer from heavy reward engineering, high variance, and slow convergence with hard explorations. Specifically, they usually take tens of hours or even days of training to mimic a simple motion sequence, resulting in poor scalability. In this work, we leverage differentiable physics simulators (DPS) and propose an efficient motion mimicking method dubbed DiffMimic. Our key insight is that DPS casts a complex policy learning task to a much simpler state matching problem. In particular, DPS learns a stable policy by analytical gradients with ground-truth physical priors hence leading to significantly faster and stabler convergence than RL-based methods. Moreover, to escape from local optima, we utilize a Demonstration Replay mechanism to enable stable gradient backpropagation in a long horizon. Extensive experiments on standard benchmarks show that DiffMimic has a better sample efficiency and time efficiency than existing methods (e.g., DeepMimic). Notably, DiffMimic allows a physically simulated character to learn Backflip after 10 minutes of training and be able to cycle it after 3 hours of training, while the existing approach may require about a day of training to cycle Backflip. More importantly, we hope DiffMimic can benefit more differentiable animation systems with techniques like differentiable clothes simulation in future research.

📄 PDF Abstract BibTeX arXiv:2304.03274

Code (2)

diffmimic/diffmimic 공식 구현
jiawei-ren/diffmimic 공식 구현 jax

Tasks

reinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Complex Locomotion Skill Learning via Differentiable Physics

2022-06-06 · Yu Fang, Jiancheng Liu, Mingrui Zhang, Jiasheng Zhang 외

Differentiable physics enables efficient gradient-based optimizations of neural network (NN) controllers. However, existing work typically only delivers NN controllers with limited capability and generalizability. We pre…

Diversity

Differentiable Dynamics for Articulated 3d Human Motion Reconstruction

2022-05-24 · CVPR 2022 1 · Erik Gärtner, Mykhaylo Andriluka, Erwin Coumans, Cristian Sminchisescu

We introduce DiffPhy, a differentiable physics-based model for articulated 3d human motion reconstruction from video. Applications of physics-based reasoning in human motion analysis have so far been limited, both by the…

3D Human Pose Estimation

Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment

2025-03-21 · CVPR 2025 1 · Hiromu Taketsugu, Takeru Oba, Takahiro Maeda, Shohei Nobuhara 외

Humans can predict future human trajectories even from momentary observations by using human pose-related cues. However, previous Human Trajectory Prediction (HTP) methods leverage the pose cues implicitly, resulting in …

PredictionTrajectory Prediction

HybridMimic: Hybrid RL-Centroidal Control for Humanoid Motion Mimicking

2026-03-06 · Ludwig Chee-Ying Tay, I-Chia Chang, Yan Gu arxiv

Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate imp…

Reinforcement Learning

Differentiable Implicit Soft-Body Physics

2021-02-11 · Junior Rojas, Eftychios Sifakis, Ladislav Kavan

We present a differentiable soft-body physics simulator that can be composed with neural networks as a differentiable layer. In contrast to other differentiable physics approaches that use explicit forward models to defi…

Numerical Integration