paper-with-me

홈 › Papers

UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robots

2025-07-10 · Kangning Yin, Weishuai Zeng, Ke Fan, Minyue Dai, Zirui Wang, Qiang Zhang, Zheng Tian, Jingbo Wang, Jiangmiao Pang, Weinan Zhang arxiv

Achieving expressive and generalizable whole-body motion control is essential for deploying humanoid robots in real-world environments. In this work, we propose UniTracker, a three-stage training framework that enables robust and scalable motion tracking across a wide range of human behaviors. In the first stage, we train a teacher policy with privileged observations to generate high-quality actions. In the second stage, we introduce a Conditional Variational Autoencoder (CVAE) to model a universal student policy that can be deployed directly on real hardware. The CVAE structure allows the policy to learn a global latent representation of motion, enhancing generalization to unseen behaviors and addressing the limitations of standard MLP-based policies under partial observations. Unlike pure MLPs that suffer from drift in global attributes like orientation, our CVAE-student policy incorporates global intent during training by aligning a partial-observation prior to the full-observation encoder. In the third stage, we introduce a fast adaptation module that fine-tunes the universal policy on harder motion sequences that are difficult to track directly. This adaptation can be performed both for single sequences and in batch mode, further showcasing the flexibility and scalability of our approach. We evaluate UniTracker in both simulation and real-world settings using a Unitree G1 humanoid, demonstrating strong performance in motion diversity, tracking accuracy, and deployment robustness.

📄 PDF Abstract BibTeX arXiv:2507.07356

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Whole-Body Humanoid Locomotion via Motion Generation and Motion Tracking

2026-04-19 · Zewei Zhang, Kehan Wen, Michael Xu, Junzhe He 외 arxiv

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcemen…

Reinforcement Learning

AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidance

2026-06-28 · Shuning Li, Sikai Li, Jiachen Li, Mingyu Ding arxiv

We present AnyBody, a unified whole-body humanoid controller driven by an arbitrary subset of body keypoints chosen at deploy time. Prior physics-based trackers either rely on expensive full-body motion capture and error…

HumanoidArena: Benchmarking Egocentric Hierarchical Whole-body Learning

2026-06-16 · Taowen Wang, Zikang Xie, Bin Yang, Yunheng Wang 외 arxiv

Humanoid robots promise whole-body interaction in human-centered environments, but scalable policy learning remains difficult because task-level decision-making and whole-body dynamic execution are tightly coupled. A pra…

Decision Making

PGMT: Perceptive General Motion Tracking for Humanoid Robots

2026-09-08 · Hongyi Li, Li Peizhuo, Yucheng Tao, Ze Wang 외 arxiv

Humanoid motion trackers can reproduce diverse whole-body motions, but their performance degrades on complex terrain where terrain-agnostic references become physically infeasible. We present PGMT, a Perceptive General M…

HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark

2026-08-13 · Dairu Liu, Zekun Qi, Jiayu Zeng, Ruixi Yu 외 arxiv

Humanoid motion tracking is central to teleoperation and whole-body imitation, yet evaluation often disagrees with what people perceive in videos. Kinematic errors average per-frame pose differences but miss the physical…