Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction

2026-03-01 · Yuhang Lin, Jiyuan Shi, Dewei Wang, Jipeng Kong, Yong Liu, Chenjia Bai, Xuelong Li arxiv

Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. First, we collect box-carrying motions that are suitable for real-world deployment and optimize penetration artifacts through a Signed Distance Field loss. Second, we propose a novel training framework that conditions the policy on a desired root-trajectory while utilizing reference motion exclusively as a reward. This design not only eliminates the need for intricate reward tuning but also establishes root trajectory as a universal interface for high-level planners, enabling simultaneous navigation and loco-manipulation. Furthermore, to ensure operational reliability, we incorporate a persistent object estimation module. By fusing real-time detection with Digital Twin, this module allows the robot to autonomously detect slippage and trigger re-grasping maneuvers. Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2603.01126

Code (0)

등록된 구현이 없습니다.

ViBe: Visual Behavior Adaptation for Perceptive Humanoid Whole-Body Control

2026-09-09 · Lokesh Krishna, Sarvesh Venkatesan, An Zhang, Quan Nguyen arxiv

Motion tracking provides a scalable recipe for humanoid whole-body control. By design, the resulting trackers lack exteroceptive feedback hence reacting to the environment remains the responsibility of a higher-level pla…

parameter-efficient fine-tuning

PILOT: A Perceptive Integrated Low-level Controller for Loco-manipulation over Unstructured Scenes

2026-01-24 · Xinru Cui, Linxi Feng, Yixuan Zhou, Haoqi Han 외 arxiv

Humanoid robots hold great potential for diverse interactions and daily service tasks within human-centered environments, necessitating controllers that seamlessly integrate precise locomotion with dexterous manipulation…

Reinforcement Learning

Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain

2026-06-06 · Zifan Wang, Yizhao Li, Teli Ma, Qiang Zhang 외 arxiv

Humanoid behavior foundation models aim to acquire reusable whole-body control policies from broad human motion priors, enabling a single controller to produce diverse and expressive behaviors. However, existing motion-c…

MARCH: Model-Assisted Reinforcement Learning for the Perceptive Control of Humanoids over Sparse Footholds

2026-06-09 · Codrin Crismariu, Ryan K. Cosner arxiv

Perceptive bipedal locomotion over sparse terrain remains a difficult challenge: model-based methods are precise but brittle to uncertainty, while model-free methods are robust but struggle to discover the precise, const…

Reinforcement Learning

ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data

2026-03-10 · Haoran Yang, Jiacheng Bao, Yucheng Xin, Haoming Song 외 arxiv

Achieving versatile and natural whole-body humanoid interaction control remains challenging due to the high cost of whole-body teleoperation data. We present ZeroWBC, a teleoperation-free framework that learns humanoid w…