Meta-Learning Regrasping Strategies for Physical-Agnostic Objects
Grasping inhomogeneous objects in real-world applications remains a challenging task due to the unknown physical properties such as mass distribution and coefficient of friction. In this study, we propose a meta-learning algorithm called ConDex, which incorporates Conditional Neural Processes (CNP) with DexNet-2.0 to autonomously discern the underlying physical properties of objects using depth images. ConDex efficiently acquires physical embeddings from limited trials, enabling precise grasping point estimation. Furthermore, ConDex is capable of updating the predicted grasping quality iteratively from new trials in an online fashion. To the best of our knowledge, we are the first who generate two object datasets focusing on inhomogeneous physical properties with varying mass distributions and friction coefficients. Extensive evaluations in simulation demonstrate ConDex's superior performance over DexNet-2.0 and existing meta-learning-based grasping pipelines. Furthermore, ConDex shows robust generalization to previously unseen real-world objects despite training solely in the simulation. The synthetic and real-world datasets will be published as well.
Code (0)
등록된 구현이 없습니다.
Tasks
FrictionMeta-LearningSimilar Papers 제목 키워드 기반
Soft Regrasping Tool Inspired by Jamming Gripper
Regrasping on fixtures is a promising approach to reduce pose uncertainty in robotic assembly, but conventional rigid fixtures lack adaptability and require dedicated designs for each part. To overcome this limitation, w…
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
In this paper, we study the problem of learning vision-based dynamic manipulation skills using a scalable reinforcement learning approach. We study this problem in the context of grasping, a longstanding challenge in rob…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Meta-Attack: Class-Agnostic and Model-Agnostic Physical Adversarial Attack
Modern deep neural networks are often vulnerable to adversarial examples. Most exist attack methods focus on crafting adversarial examples in the digital domain, while only limited works study physical adversarial at…
Adversarial AttackFew-Shot LearningMeta-LearningBi-directional Digital Twin and Edge Computing in the Metaverse
The Metaverse has emerged to extend our lifestyle beyond physical limitations. As essential components in the Metaverse, digital twins (DTs) are the real-time digital replicas of physical items. Multi-access edge computi…
Continual LearningEdge-computingCollaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolution
Estimating the pose and shape of hands and objects under interaction finds numerous applications including augmented and virtual reality. Existing approaches for hand and object reconstruction require explicitly defined …
3D Hand Pose Estimation3D Pose Estimationhand-object poseObject+2