paper-with-me

Papers

Composite Motion Learning with Task Control

2023-05-05 · Pei Xu, Xiumin Shang, Victor Zordan, Ioannis Karamouzas

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn decoupled motions for specific body parts from multiple reference motions simultaneously and directly by leveraging the use of multiple discriminators in a GAN-like setup. In this process, there is no need of any manual work to produce composite reference motions for learning. Instead, the control policy explores by itself how the composite motions can be combined automatically. We further account for multiple task-specific rewards and train a single, multi-objective control policy. To this end, we propose a novel framework for multi-objective learning that adaptively balances the learning of disparate motions from multiple sources and multiple goal-directed control objectives. In addition, as composite motions are typically augmentations of simpler behaviors, we introduce a sample-efficient method for training composite control policies in an incremental manner, where we reuse a pre-trained policy as the meta policy and train a cooperative policy that adapts the meta one for new composite tasks. We show the applicability of our approach on a variety of challenging multi-objective tasks involving both composite motion imitation and multiple goal-directed control.

📄 PDF Abstract BibTeX arXiv:2305.03286

Code (3)

xupei0610/compositemotion 공식 구현 pytorch
xupei0610/AdaptNet pytorch
xupei0610/guitar pytorch

Similar Papers 제목 키워드 기반

CASIM: Composite Aware Semantic Injection for Text to Motion Generation

2025-02-04 · Che-Jui Chang, Qingze Tony Liu, Honglu Zhou, Vladimir Pavlovic 외

Recent advances in generative modeling and tokenization have driven significant progress in text-to-motion generation, leading to enhanced quality and realism in generated motions. However, effectively leveraging textual…

Motion Generation

Dynamic Compositional Graph Convolutional Network for Efficient Composite Human Motion Prediction

2023-11-23 · Wanying Zhang, Shen Zhao, Fanyang Meng, Songtao Wu 외

With potential applications in fields including intelligent surveillance and human-robot interaction, the human motion prediction task has become a hot research topic and also has achieved high success, especially using …

Action GenerationHuman motion predictionmotion predictionPrediction

AgentSteerTTS: A Multi-Agent Closed-Loop Framework for Composite-Instruction Text-to-Speech

2026-05-14 · Bin Kang, Shaoguo Wen, Yang Fan, Shunlong Wu 외 arxiv

While existing text-to-speech (TTS) models exhibit high expressiveness, fine-grained control over composite instructions remains challenging due to the structural mismatch between discrete textual intents and continuous …

Continuous Control

CWI: Composite Humanoid Whole-Body Imitation System for Loco-manipulation

2026-06-26 · Wenqi Ge, Junde Guo, Zhen Fu, Shunpeng Yang 외 arxiv

Achieving everyday tasks with humanoid robots requires coordinating stable locomotion with versatile manipulation. However, existing whole-body controllers still face significant challenges. Methods trained solely via co…

Aggregated Multi-GANs for Controlled 3D Human Motion Prediction

2021-03-17 · Zhenguang Liu, Kedi Lyu, Shuang Wu, Haipeng Chen 외

Human motion prediction from historical pose sequence is at the core of many applications in machine intelligence. However, in current state-of-the-art methods, the predicted future motion is confined within the same act…

Human motion predictionmotion predictionPrediction