paper-with-me

홈 › Papers

DualAfford: Learning Collaborative Visual Affordance for Dual-gripper Manipulation

2022-07-05 · Yan Zhao, Ruihai Wu, Zhehuan Chen, Yourong Zhang, Qingnan Fan, Kaichun Mo, Hao Dong

It is essential yet challenging for future home-assistant robots to understand and manipulate diverse 3D objects in daily human environments. Towards building scalable systems that can perform diverse manipulation tasks over various 3D shapes, recent works have advocated and demonstrated promising results learning visual actionable affordance, which labels every point over the input 3D geometry with an action likelihood of accomplishing the downstream task (e.g., pushing or picking-up). However, these works only studied single-gripper manipulation tasks, yet many real-world tasks require two hands to achieve collaboratively. In this work, we propose a novel learning framework, DualAfford, to learn collaborative affordance for dual-gripper manipulation tasks. The core design of the approach is to reduce the quadratic problem for two grippers into two disentangled yet interconnected subtasks for efficient learning. Using the large-scale PartNet-Mobility and ShapeNet datasets, we set up four benchmark tasks for dual-gripper manipulation. Experiments prove the effectiveness and superiority of our method over three baselines.

📄 PDF Abstract BibTeX arXiv:2207.01971

Code (0)

등록된 구현이 없습니다.

Tasks

3D geometry

Similar Papers 제목 키워드 기반

Contrastively Learning Visual Attention as Affordance Cues from Demonstrations for Robotic Grasping

2021-04-02 · Yantian Zha, Siddhant Bhambri, Lin Guan

Conventional works that learn grasping affordance from demonstrations need to explicitly predict grasping configurations, such as gripper approaching angles or grasping preshapes. Classic motion planners could then sampl…

Contrastive LearningDecoderImitation LearningRobotic Grasping+1

Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

2023-02-21 · Yuhong Deng, Xiaofeng Guo, Yixuan Wei, Kai Lu 외

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object sta…

Deep Reinforcement LearningObjectreinforcement-learningReinforcement Learning (RL)+1

GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping

2024-11-19 · Teli Ma, Zifan Wang, Jiaming Zhou, Mengmeng Wang 외

Inferring affordable (i.e., graspable) parts of arbitrary objects based on human specifications is essential for robots advancing toward open-vocabulary manipulation. Current grasp planners, however, are hindered by limi…

Common Sense ReasoningHuman-Object Interaction DetectionPose EstimationWorld Knowledge

Mining Semantic Affordances of Visual Object Categories

2015-06-01 · CVPR 2015 6 · Yu-Wei Chao, Zhan Wang, Rada Mihalcea, Jia Deng

Affordances are fundamental attributes of objects. Affordances reveal the functionalities of objects and the possible actions that can be performed on them. Understanding affordances is crucial for recognizing human acti…

Collaborative FilteringObject

Visual-Geometric Collaborative Guidance for Affordance Learning

2024-10-15 · Hongchen Luo, Wei Zhai, Jiao Wang, Yang Cao 외

Perceiving potential ``action possibilities'' (\ie, affordance) regions of images and learning interactive functionalities of objects from human demonstration is a challenging task due to the diversity of human-object in…

Human-Object Interaction DetectionObject