Orientation Attentive Robotic Grasp Synthesis with Augmented Grasp Map Representation
Inherent morphological characteristics in objects may offer a wide range of plausible grasping orientations that obfuscates the visual learning of robotic grasping. Existing grasp generation approaches are cursed to construct discontinuous grasp maps by aggregating annotations for drastically different orientations per grasping point. Moreover, current methods generate grasp candidates across a single direction in the robot's viewpoint, ignoring its feasibility constraints. In this paper, we propose a novel augmented grasp map representation, suitable for pixel-wise synthesis, that locally disentangles grasping orientations by partitioning the angle space into multiple bins. Furthermore, we introduce the ORientation AtteNtive Grasp synthEsis (ORANGE) framework, that jointly addresses classification into orientation bins and angle-value regression. The bin-wise orientation maps further serve as an attention mechanism for areas with higher graspability, i.e. probability of being an actual grasp point. We report new state-of-the-art 94.71% performance on Jacquard, with a simple U-Net using only depth images, outperforming even multi-modal approaches. Subsequent qualitative results with a real bi-manual robot validate ORANGE's effectiveness in generating grasps for multiple orientations, hence allowing planning grasps that are feasible.
Code (1)
Tasks
Grasp GenerationRobotic GraspingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pixel-Attentive Policy Gradient for Multi-Fingered Grasping in Cluttered Scenes
Recent advances in on-policy reinforcement learning (RL) methods enabled learning agents in virtual environments to master complex tasks with high-dimensional and continuous observation and action spaces. However, levera…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Robotic GraspingFastOrient: Lightweight Computer Vision for Wrist Control in Assistive Robotic Grasping
Wearable and Assistive robotics for human grasp support are broadly either tele-operated robotic arms or act through orthotic control of a paralyzed user's hand. Such devices require correct orientation for successful an…
Robotic GraspingROG-Grasp: Root-Oriented Geometry for Robotic Grasping and Placement
Orientation-aware manipulation is essential in post-harvest agricultural processing, where produce must be grasped and placed in consistent configurations. This paper presents ROG-Grasp, a geometry-based robotic grasping…
Robotic GraspingMotion PlanningDexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling
Robotic grasping is a fundamental yet crucial component of robotic applications, as effective grasping often serves as the starting point for various tasks. With the rapid advancement of neural networks, data-driven appr…
Data AugmentationRobotic GraspingA Segmented Robot Grasping Perception Neural Network for Edge AI
Robotic grasping, the ability of robots to reliably secure and manipulate objects of varying shapes, sizes and orientations, is a complex task that requires precise perception and control. Deep neural networks have shown…
Dimensionality ReductionRobotic Grasping