DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects

2023-05-09 · CVPR 2023 1 · Chen Bao, Helin Xu, Yuzhe Qin, Xiaolong Wang

To enable general-purpose robots, we will require the robot to operate daily articulated objects as humans do. Current robot manipulation has heavily relied on using a parallel gripper, which restricts the robot to a limited set of objects. On the other hand, operating with a multi-finger robot hand will allow better approximation to human behavior and enable the robot to operate on diverse articulated objects. To this end, we propose a new benchmark called DexArt, which involves Dexterous manipulation with Articulated objects in a physical simulator. In our benchmark, we define multiple complex manipulation tasks, and the robot hand will need to manipulate diverse articulated objects within each task. Our main focus is to evaluate the generalizability of the learned policy on unseen articulated objects. This is very challenging given the high degrees of freedom of both hands and objects. We use Reinforcement Learning with 3D representation learning to achieve generalization. Through extensive studies, we provide new insights into how 3D representation learning affects decision making in RL with 3D point cloud inputs. More details can be found at https://www.chenbao.tech/dexart/.

📄 PDF Abstract BibTeX arXiv:2305.05706

Code (1)

Kami-code/dexart-release 공식 구현 pytorch

Tasks

Benchmarking Decision Making Representation Learning Robot Manipulation

A Novel Task-Driven Diffusion-Based Policy with Affordance Learning for Generalizable Manipulation of Articulated Objects

2025-09-18 · Hao Zhang, Zhen Kan, Weiwei Shang, Yongduan Song arxiv

Despite recent advances in dexterous manipulations, the manipulation of articulated objects and generalization across different categories remain significant challenges. To address these issues, we introduce DART, a nove…

Reinforcement Learning

Mana: Dexterous Manipulation of Articulated Tools

2026-06-11 · Zhao-Heng Yin, Guanya Shi, Pieter Abbeel, C. Karen Liu arxiv

Articulated tool manipulation remains a major challenge in dexterous robotics due to the need to coordinate internal degrees of freedom and contact-rich interactions. While prior work has largely focused on rigid objects…

Reinforcement Learning Motion Planning

Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Control

2025-02-20 · Tan-Dzung Do, Nandiraju Gireesh, Jilong Wang, He Wang

Articulated object manipulation poses a unique challenge compared to rigid object manipulation as the object itself represents a dynamic environment. In this work, we present a novel RL-based pipeline equipped with varia…

Motion Planning Object

DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects

2026-06-13 · Tianshan Zhang, Yijia Duan, Yanjun Li, Zeyu Zhang 외 arxiv

Dexterous interaction with articulated objects is important for household, assistive, and humanoid manipulation, where multi-finger hands can provide compliant contact patterns beyond parallel-jaw grasping. However, arti…

Hierarchical Reinforcement Learning for Articulated Tool Manipulation with Multifingered Hand

2025-07-09 · Wei Xu, Yanchao Zhao, Weichao Guo, Xinjun Sheng arxiv

Manipulating articulated tools, such as tweezers or scissors, has rarely been explored in previous research. Unlike rigid tools, articulated tools change their shape dynamically, creating unique challenges for dexterous …

Hierarchical Reinforcement Learning Point Clouds