Vision-based Vineyard Navigation Solution with Automatic Annotation
Autonomous navigation is the key to achieving the full automation of agricultural research and production management (e.g., disease management and yield prediction) using agricultural robots. In this paper, we introduced a vision-based autonomous navigation framework for agriculture robots in trellised cropping systems such as vineyards. To achieve this, we proposed a novel learning-based method to estimate the path traversibility heatmap directly from an RGB-D image and subsequently convert the heatmap to a preferred traversal path. An automatic annotation pipeline was developed to form a training dataset by projecting RTK GPS paths collected during the first setup in a vineyard in corresponding RGB-D images as ground-truth path annotations, allowing a fast model training and fine-tuning without costly human annotation. The trained path detection model was used to develop a full navigation framework consisting of row tracking and row switching modules, enabling a robot to traverse within a crop row and transit between crop rows to cover an entire vineyard autonomously. Extensive field trials were conducted in three different vineyards to demonstrate that the developed path detection model and navigation framework provided a cost-effective, accurate, and robust autonomous navigation solution in the vineyard and could be generalized to unseen vineyards with stable performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous NavigationManagementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Position-Agnostic Autonomous Navigation in Vineyards with Deep Reinforcement Learning
Precision agriculture is rapidly attracting research to efficiently introduce automation and robotics solutions to support agricultural activities. Robotic navigation in vineyards and orchards offers competitive advantag…
Autonomous NavigationDeep Reinforcement LearningPositionreinforcement-learning+3Deep Semantic Segmentation at the Edge for Autonomous Navigation in Vineyard Rows
Precision agriculture is a fast-growing field that aims at introducing affordable and effective automation into agricultural processes. Nowadays, algorithmic solutions for navigation in vineyards require expensive sensor…
Autonomous NavigationSegmentationSemantic SegmentationViViD-5K: Vineyard vision dataset for field-based berry detection and segmentation and grape cluster closure estimation
Cluster closure, defined as the progressive filling of gaps between the berries in a grape bunch, is a key trait in vineyard management, impacting disease risk. However, traditional visual scoring methods are labor-inten…
Keypoint Semantic Integration for Improved Feature Matching in Outdoor Agricultural Environments
Robust robot navigation in outdoor environments requires accurate perception systems capable of handling visual challenges such as repetitive structures and changing appearances. Visual feature matching is crucial to vis…
Pose EstimationRobot NavigationTEMPO-VINE: A Multi-Temporal Sensor Fusion Dataset for Localization and Mapping in Vineyards
In recent years, precision agriculture has been introducing groundbreaking innovations in the field, with a strong focus on automation. However, research studies in robotics and autonomous navigation often rely on contro…