paper-with-me

홈 › Papers

SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation

2024-07-15 · Jordan Juravsky, Yunrong Guo, Sanja Fidler, Xue Bin Peng

Physically-simulated models for human motion can generate high-quality responsive character animations, often in real-time. Natural language serves as a flexible interface for controlling these models, allowing expert and non-expert users to quickly create and edit their animations. Many recent physics-based animation methods, including those that use text interfaces, train control policies using reinforcement learning (RL). However, scaling these methods beyond several hundred motions has remained challenging. Meanwhile, kinematic animation models are able to successfully learn from thousands of diverse motions by leveraging supervised learning methods. Inspired by these successes, in this work we introduce SuperPADL, a scalable framework for physics-based text-to-motion that leverages both RL and supervised learning to train controllers on thousands of diverse motion clips. SuperPADL is trained in stages using progressive distillation, starting with a large number of specialized experts using RL. These experts are then iteratively distilled into larger, more robust policies using a combination of reinforcement learning and supervised learning. Our final SuperPADL controller is trained on a dataset containing over 5000 skills and runs in real time on a consumer GPU. Moreover, our policy can naturally transition between skills, allowing for users to interactively craft multi-stage animations. We experimentally demonstrate that SuperPADL significantly outperforms RL-based baselines at this large data scale.

📄 PDF Abstract BibTeX arXiv:2407.10481

Code (0)

등록된 구현이 없습니다.

Tasks

GPUReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

PADL: Language-Directed Physics-Based Character Control

2023-01-31 · Jordan Juravsky, Yunrong Guo, Sanja Fidler, Xue Bin Peng

Developing systems that can synthesize natural and life-like motions for simulated characters has long been a focus for computer animation. But in order for these systems to be useful for downstream applications, they ne…

Image GenerationImitation LearningMultiple-choiceProgram Synthesis+1

Similar Formation Control of Multi-Agent Systems over Directed Acyclic Graphs via Matrix-Weighted Laplacian

2025-06-14 · Zhipeng Fan, Yujie Xu, Mingyu Fu, Han Sun 외

This brief proposes a distributed formation control strategy via matrix-weighted Laplacian that can achieve a similar formation in 2-D planar using inter-agent relative displacement measurement. Formation patterns that i…

SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control

2026-05-21 · Jingyan Zhang, Han Liang, Ruichi Zhang, Bin Li 외 arxiv

Controlling physics-based humanoids from natural-language instructions is a critical step toward general-purpose embodied agents. However, existing methods remain constrained by a tension between semantic expressiveness …

Reinforcement LearningInstruction Following

Latent-Space Causal Discovery from Indirect Neuroimaging Observations

2026-01-30 · Sangyoon Bae, Miruna Oprescu, David Keetae Park, Shinjae Yoo 외 arxiv

Neuroimaging does not observe causal variables directly: hemodynamics and volume conduction distort signals so that statistical dependence need not reflect latent neural influence. Before estimating graphs, one must spec…

2-D Directed Formation Control Based on Bipolar Coordinates

2021-08-02 · Farhad Mehdifar, Charalampos P. Bechlioulis, Julien M. Hendrickx, Dimos V. Dimarogonas

This work proposes a novel 2-D formation control scheme for acyclic triangulated directed graphs (a class of minimally acyclic persistent graphs) based on bipolar coordinates with (almost) global convergence to the desir…