Geometry-Aware Fruit Grasping Estimation for Robotic Harvesting in Orchards

2021-12-08 · Hanwen Kang, Xing Wang, Chao Chen

Field robotic harvesting is a promising technique in recent development of agricultural industry. It is vital for robots to recognise and localise fruits before the harvesting in natural orchards. However, the workspace of harvesting robots in orchards is complex: many fruits are occluded by branches and leaves. It is important to estimate a proper grasping pose for each fruit before performing the manipulation. In this study, a geometry-aware network, A3N, is proposed to perform end-to-end instance segmentation and grasping estimation using both color and geometry sensory data from a RGB-D camera. Besides, workspace geometry modelling is applied to assist the robotic manipulation. Moreover, we implement a global-to-local scanning strategy, which enables robots to accurately recognise and retrieve fruits in field environments with two consumer-level RGB-D cameras. We also evaluate the accuracy and robustness of proposed network comprehensively in experiments. The experimental results show that A3N achieves 0.873 on instance segmentation accuracy, with an average computation time of 35 ms. The average accuracy of grasping estimation is 0.61 cm and 4.8$^{\circ}$ in centre and orientation, respectively. Overall, the robotic system that utilizes the global-to-local scanning and A3N, achieves success rate of harvesting ranging from 70\% - 85\% in field harvesting experiments.

📄 PDF Abstract BibTeX arXiv:2112.04363

Code (0)

등록된 구현이 없습니다.

Tasks

Instance Segmentation Semantic Segmentation

Real-Time Fruit Recognition and Grasping Estimation for Autonomous Apple Harvesting

2020-03-30 · Hanwen Kang, Chao Chen

In this research, a fully neural network based visual perception framework for autonomous apple harvesting is proposed. The proposed framework includes a multi-function neural network for fruit recognition and a Pointnet…

Instance Segmentation Robotic Grasping Semantic Segmentation

V2F: Vision-Informed Grasp Force Prediction for Damage-Aware Robotic Handling of Date Fruits

2026-07-22 · Shahd Shami, Obadah Wali, Eric Feron, Shinkyu Park arxiv

This paper presents a vision-informed grasp force prediction framework for robotic handling of date fruits. Addressing the dual challenge of high detachment forces and low bruise thresholds, we first conduct mechanical c…

GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors

2026-06-07 · Dongli Wu, Xiaobao Wei, Hao Wang, Qiaochu Dong 외 arxiv

Robotic grasping is a fundamental capability in robotic manipulation. Yet grasping remains challenging under partial observations. Reliable grasping depends on both local contact cues and object-level 3D structure. Exist…

Robotic Grasping Pose Prediction

Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies

2022-11-20 · Malte Mosbach, Sven Behnke

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known obj…

Object reinforcement-learning Reinforcement Learning (RL)

OMNI-PoseX: A Fast Vision Model for 6D Object Pose Estimation in Embodied Tasks

2026-04-03 · Michael Zhang, Wei Ying, Fangwen Chen, Shifeng Bai 외 arxiv

Accurate 6D object pose estimation is a fundamental capability for embodied agents, yet remains highly challenging in open-world environments. Many existing methods often rely on closed-set assumptions or geometry-agnost…

Zero-shot Generalization 6D Pose Estimation Robotic Grasping