paper-with-me

홈 › Papers

Learning Extrinsic Dexterity with Parameterized Manipulation Primitives

2023-10-26 · Shih-Min Yang, Martin Magnusson, Johannes A. Stork, Todor Stoyanov

Many practically relevant robot grasping problems feature a target object for which all grasps are occluded, e.g., by the environment. Single-shot grasp planning invariably fails in such scenarios. Instead, it is necessary to first manipulate the object into a configuration that affords a grasp. We solve this problem by learning a sequence of actions that utilize the environment to change the object's pose. Concretely, we employ hierarchical reinforcement learning to combine a sequence of learned parameterized manipulation primitives. By learning the low-level manipulation policies, our approach can control the object's state through exploiting interactions between the object, the gripper, and the environment. Designing such a complex behavior analytically would be infeasible under uncontrolled conditions, as an analytic approach requires accurate physical modeling of the interaction and contact dynamics. In contrast, we learn a hierarchical policy model that operates directly on depth perception data, without the need for object detection, pose estimation, or manual design of controllers. We evaluate our approach on picking box-shaped objects of various weight, shape, and friction properties from a constrained table-top workspace. Our method transfers to a real robot and is able to successfully complete the object picking task in 98\% of experimental trials. Supplementary information and videos can be found at https://shihminyang.github.io/ED-PMP/.

📄 PDF Abstract BibTeX arXiv:2310.17785

Code (0)

등록된 구현이 없습니다.

Tasks

FrictionHierarchical Reinforcement LearningObjectobject-detectionObject DetectionPose Estimation

Similar Papers 제목 키워드 기반

Emerging Extrinsic Dexterity in Cluttered Scenes via Dynamics-aware Policy Learning

2026-03-10 · Yixin Zheng, Jiangran Lyu, Yifan Zhang, Jiayi Chen 외 arxiv

Extrinsic dexterity leverages environmental contact to overcome the limitations of prehensile manipulation. However, achieving such dexterity in cluttered scenes remains challenging and underexplored, as it requires sele…

Reinforcement Learning

Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity

2022-11-02 · Wenxuan Zhou, David Held

A simple gripper can solve more complex manipulation tasks if it can utilize the external environment such as pushing the object against the table or a vertical wall, known as "Extrinsic Dexterity." Previous work in extr…

FrictionObjectReinforcement Learning (RL)

Agile-VLA: Few-Shot Industrial Pose Rectification via Implicit Affordance Anchoring

2026-03-24 · Teng Yan, Zhengyang Pei, Chengyu Shi, Yue Yu 외 arxiv

Deploying Vision-Language-Action (VLA) models on resource-constrained edge platforms encounters a fundamental conflict between high-latency semantic inference and the high-frequency control required for dynamic manipulat…

Micro-Dexterity in Biological Micromanipulation: Embodiment, Perception, and Control

2026-04-13 · Kangyi Lu, Lan Wei, Zongcai Tan, Dandan Zhang arxiv

Microscale manipulation has advanced substantially in controlled locomotion and targeted transport, yet many biomedical applications require precise and adaptive interaction with biological micro-objects. At these scales…

DexterityGen: Foundation Controller for Unprecedented Dexterity

2025-02-06 · Zhao-Heng Yin, Changhao Wang, Luis Pineda, Francois Hogan 외

Teaching robots dexterous manipulation skills, such as tool use, presents a significant challenge. Current approaches can be broadly categorized into two strategies: human teleoperation (for imitation learning) and sim-t…

Imitation Learning