paper-with-me

홈 › Papers

H-GAP: Humanoid Control with a Generalist Planner

2023-12-05 · Zhengyao Jiang, Yingchen Xu, Nolan Wagener, Yicheng Luo, Michael Janner, Edward Grefenstette, Tim Rocktäschel, Yuandong Tian

Humanoid control is an important research challenge offering avenues for integration into human-centric infrastructures and enabling physics-driven humanoid animations. The daunting challenges in this field stem from the difficulty of optimizing in high-dimensional action spaces and the instability introduced by the bipedal morphology of humanoids. However, the extensive collection of human motion-captured data and the derived datasets of humanoid trajectories, such as MoCapAct, paves the way to tackle these challenges. In this context, we present Humanoid Generalist Autoencoding Planner (H-GAP), a state-action trajectory generative model trained on humanoid trajectories derived from human motion-captured data, capable of adeptly handling downstream control tasks with Model Predictive Control (MPC). For 56 degrees of freedom humanoid, we empirically demonstrate that H-GAP learns to represent and generate a wide range of motor behaviours. Further, without any learning from online interactions, it can also flexibly transfer these behaviors to solve novel downstream control tasks via planning. Notably, H-GAP excels established MPC baselines that have access to the ground truth dynamics model, and is superior or comparable to offline RL methods trained for individual tasks. Finally, we do a series of empirical studies on the scaling properties of H-GAP, showing the potential for performance gains via additional data but not computing. Code and videos are available at https://ycxuyingchen.github.io/hgap/.

📄 PDF Abstract BibTeX arXiv:2312.02682

Code (0)

등록된 구현이 없습니다.

Tasks

Humanoid ControlModel Predictive ControlOffline RL

Similar Papers 제목 키워드 기반

Embodiment-Aware Generalist Specialist Distillation for Unified Humanoid Whole-Body Control

2026-02-03 · Quanquan Peng, Yunfeng Lin, Yufei Xue, Jiangmiao Pang 외 arxiv

Humanoid Whole-Body Controllers trained with reinforcement learning (RL) have recently achieved remarkable performance, yet many target a single robot embodiment. Variations in dynamics, degrees of freedom (DoFs), and ki…

Reinforcement Learning

SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control

2025-11-11 · Zhengyi Luo, Ye Yuan, Tingwu Wang, Chenran Li 외 arxiv

Despite the rise of billion-parameter foundation models trained across thousands of graphical processing units (GPUs), similar scaling gains have not been shown for humanoid control. Current neural controllers for humano…

Extreme-RGMT: Continual Learning of Highly Dynamic Skills for Robust Generalist Humanoid Control

2026-07-22 · Yubiao Ma, Han Yu, Kai Guo, Changtai Lv 외 arxiv

Humans can progressively acquire highly dynamic motor skills while preserving reliable everyday motor abilities. In contrast, existing humanoid controllers face a trade-off between generalist and specialist capabilities:…

Continual Learning

From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots

2025-06-15 · Yuxuan Wang, Ming Yang, Weishuai Zeng, Yu Zhang 외

Achieving general agile whole-body control on humanoid robots remains a major challenge due to diverse motion demands and data conflicts. While existing frameworks excel in training single motion-specific policies, they …

Clustering

FADA: Few-Shot Domain Adaptation via Dynamics Alignment for Humanoid Control

2026-06-26 · Angchen Xie, Nikhil Sobanbabu, Ishayu Shikhare, Alan Wang 외 arxiv

High-precision humanoid control is limited by target-domain dynamics mismatch, where the same control objective can induce different realized motions under changes in terrain, payload, or actuator response. Existing meth…

Domain Adaptation