paper-with-me

Papers

A GAN-Like Approach for Physics-Based Imitation Learning and Interactive Character Control

2021-05-21 · Pei Xu, Ioannis Karamouzas

We present a simple and intuitive approach for interactive control of physically simulated characters. Our work builds upon generative adversarial networks (GAN) and reinforcement learning, and introduces an imitation learning framework where an ensemble of classifiers and an imitation policy are trained in tandem given pre-processed reference clips. The classifiers are trained to discriminate the reference motion from the motion generated by the imitation policy, while the policy is rewarded for fooling the discriminators. Using our GAN-based approach, multiple motor control policies can be trained separately to imitate different behaviors. In runtime, our system can respond to external control signal provided by the user and interactively switch between different policies. Compared to existing methods, our proposed approach has the following attractive properties: 1) achieves state-of-the-art imitation performance without manually designing and fine tuning a reward function; 2) directly controls the character without having to track any target reference pose explicitly or implicitly through a phase state; and 3) supports interactive policy switching without requiring any motion generation or motion matching mechanism. We highlight the applicability of our approach in a range of imitation and interactive control tasks, while also demonstrating its ability to withstand external perturbations as well as to recover balance. Overall, our approach generates high-fidelity motion, has low runtime cost, and can be easily integrated into interactive applications and games.

📄 PDF Abstract BibTeX arXiv:2105.10066

Code (4)

xupei0610/ICCGAN 공식 구현 pytorch
xupei0610/AdaptNet pytorch
xupei0610/compositemotion pytorch
xupei0610/guitar pytorch

Tasks

Imitation LearningMotion Generation

Similar Papers 제목 키워드 기반

MAAIP: Multi-Agent Adversarial Interaction Priors for imitation from fighting demonstrations for physics-based characters

2023-11-04 · Mohamed Younes, Ewa Kijak, Richard Kulpa, Simon Malinowski 외

Simulating realistic interaction and motions for physics-based characters is of great interest for interactive applications, and automatic secondary character animation in the movie and video game industries. Recent work…

Imitation Learning

MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpainting

2024-09-22 · Chen Tessler, Yunrong Guo, Ofir Nabati, Gal Chechik 외

Crafting a single, versatile physics-based controller that can breathe life into interactive characters across a wide spectrum of scenarios represents an exciting frontier in character animation. An ideal controller shou…

C$\cdot$ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characters

2023-09-20 · Zhiyang Dou, Xuelin Chen, Qingnan Fan, Taku Komura 외

We present C$\cdot$ASE, an efficient and effective framework that learns conditional Adversarial Skill Embeddings for physics-based characters. Our physically simulated character can learn a diverse repertoire of skills …

Imitation Learning

Physics-based Motion Retargeting from Sparse Inputs

2023-07-04 · Daniele Reda, Jungdam Won, Yuting Ye, Michiel Van de Panne 외

Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset an…

motion retargeting

PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learning

2025-03-21 · Yan Zhang, Yao Feng, Alpár Cseke, Nitin Saini 외

To build a motor system of the interactive avatar, it is essential to develop a generative motion model drives the body to move through 3D space in a perpetual, realistic, controllable, and responsive manner. Although mo…

Action GenerationMotion Generation