Viewpoint Optimization for Autonomous Strawberry Harvesting with Deep Reinforcement Learning

2019-03-05 · Jonathon Sather, Xiaozheng Jane Zhang

Autonomous harvesting may provide a viable solution to mounting labor pressures in the United States's strawberry industry. However, due to bottlenecks in machine perception and economic viability, a profitable and commercially adopted strawberry harvesting system remains elusive. In this research, we explore the feasibility of using deep reinforcement learning to overcome these bottlenecks and develop a practical algorithm to address the sub-objective of viewpoint optimization, or the development of a control policy to direct a camera to favorable vantage points for autonomous harvesting. We evaluate the algorithm's performance in a custom, open-source simulated environment and observe encouraging results. Our trained agent yields 8.7 times higher returns than random actions and 8.8 percent faster exploration than our best baseline policy, which uses visual servoing. Visual investigation shows the agent is able to fixate on favorable viewpoints, despite having no explicit means to propagate information through time. Overall, we conclude that deep reinforcement learning is a promising area of research to advance the state of the art in autonomous strawberry harvesting.

📄 PDF Abstract BibTeX arXiv:1903.02074

Code (1)

jsather/harvester-sim 공식 구현

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Autonomous Strawberry Picking Robotic System (Robofruit)

2023-01-10 · Soran Parsa, Bappaditya Debnath, Muhammad Arshad Khan, Amir Ghalamzan E.

Challenges in strawberry picking made selective harvesting robotic technology demanding. However, selective harvesting of strawberries is complicated forming a few scientific research questions. Most available solutions …

Robotic Strawberry Harvesting with Robust Vision and Deep Reinforcement Learning based Sim-to-Real Control

2026-05-22 · Al Bashir, Shao-Yang Chang, Partho Ghose, Prem Raj 외 arxiv

This study presents a closed-loop robotic strawberry harvesting system that combines a robust vision module, simulation-trained deep reinforcement learning (DRL) control, and ROS-based realrobot execution. For perception…

Reinforcement Learning Instance Segmentation

Reinforcement Learning for the Full Strawberry Harvesting Process: Obstacle Separation, Detachment, and Placement

2026-07-16 · Changyou Miao, Teng Li, Ya Xiong arxiv

Severe occlusions and deformable plant structures introduce complex contact dynamics that challenge robotic strawberry harvesting. A policy-driven reinforcement learning (RL) framework with heuristic phase coordination w…

Reinforcement Learning

Vision-Based Early Fault Diagnosis and Self-Recovery for Strawberry Harvesting Robots

2026-01-05 · Meili Sun, Chunjiang Zhao, Lichao Yang, Hao Liu 외 arxiv

Strawberry-harvesting robots faced challenges such as poor visual perception, gripper misalignment, empty grasp/misgrasp, and slippage, which reduced harvesting stability and efficiency.To overcome these issues, this pap…

Fault Diagnosis

Data-driven worker activity recognition and picking efficiency estimation in manual strawberry harvesting

2025-03-28 · Uddhav Bhattarai, Rajkishan Arikapudi, Steven A. Fennimore, Frank N Martin 외

Manual fruit harvesting is common in agriculture, but the amount of time that pickers spend on nonproductive activities can make it very inefficient. Accurately identifying picking vs. non-picking activity is crucial for…

Activity Recognition