paper-with-me

홈 › Papers

ObjRetarget: An Object-Aware Motion Retargeting Framework with Anthropomorphic Arm Constraints and Polyhedral Hand Modeling

2026-07-04 · Yuanchuan Lai, Qing Gao, Ziyan Liang, Junjie Hu, Zhaojie Ju arxiv

Learning robot dexterous manipulation from human manipulation videos requires reliably retargeting human intent to executable robot actions while maintaining stable hand-object contact, which remains a key challenge in embodied intelligence. Existing retargeting methods often ignore explicit contact modeling or rely on reinforcement learning, resulting in limited accuracy and generalization. To address this, we propose ObjRetarget, a human-to-robot motion retargeting framework for learning robot dexterous manipulation from human videos, which integrates anthropomorphic arm trajectory constraints with structured hand-object geometric modeling. For arm motion, reference trajectories extracted from human videos are used for initialization, followed by anthropomorphic constraints and redundancy-aware optimization to generate natural and accurate movements. For hand manipulation, ObjRetarget represents multi-finger contacts using polytope clusters and preserves contact structure through geometric invariants to improve stability. Experiments on real robots show that ObjRetarget improves manipulation success rates and contact stability across multiple dexterous tasks, and generalizes well to different demonstrations, object poses, and task settings.

📄 PDF Abstract BibTeX arXiv:2607.03828

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Pose-aware Attention Network for Flexible Motion Retargeting by Body Part

2023-06-13 · Lei Hu, Zihao Zhang, Chongyang Zhong, Boyuan Jiang 외

Motion retargeting is a fundamental problem in computer graphics and computer vision. Existing approaches usually have many strict requirements, such as the source-target skeletons needing to have the same number of join…

motion retargeting

Semantics-aware Motion Retargeting with Vision-Language Models

2023-12-04 · CVPR 2024 1 · Haodong Zhang, ZhiKe Chen, Haocheng Xu, Lei Hao 외

Capturing and preserving motion semantics is essential to motion retargeting between animation characters. However, most of the previous works neglect the semantic information or rely on human-designed joint-level repres…

Language ModelingLanguage Modellingmotion retargeting

Correspondence-free online human motion retargeting

2023-02-01 · Rim Rekik, Mathieu Marsot, Anne-Hélène Olivier, Jean-Sébastien Franco 외

We present a data-driven framework for unsupervised human motion retargeting that animates a target subject with the motion of a source subject. Our method is correspondence-free, requiring neither spatial correspondence…

motion retargeting

AdaMorph: Unified Motion Retargeting via Embodiment-Aware Adaptive Transformers

2026-01-12 · Haoyu Zhang, Shibo Jin, Lusong Li, Jun Li 외 arxiv

Retargeting human motion to heterogeneous robots is a fundamental challenge in robotics, primarily due to the severe kinematic and dynamic discrepancies between varying embodiments. Existing solutions typically resort to…

Zero-shot Generalization

Skeleton-Aware Networks for Deep Motion Retargeting

2020-05-12 · Kfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung 외

We introduce a novel deep learning framework for data-driven motion retargeting between skeletons, which may have different structure, yet corresponding to homeomorphic graphs. Importantly, our approach learns how to ret…

motion retargetingMotion Synthesis