From Plants to Landmarks: Time-invariant Plant Localization that uses Deep Pose Regression in Agricultural Fields
Agricultural robots are expected to increase yields in a sustainable way and automate precision tasks, such as weeding and plant monitoring. At the same time, they move in a continuously changing, semi-structured field environment, in which features can hardly be found and reproduced at a later time. Challenges for Lidar and visual detection systems stem from the fact that plants can be very small, overlapping and have a steadily changing appearance. Therefore, a popular way to localize vehicles with high accuracy is based on ex- pensive global navigation satellite systems and not on natural landmarks. The contribution of this work is a novel image- based plant localization technique that uses the time-invariant stem emerging point as a reference. Our approach is based on a fully convolutional neural network that learns landmark localization from RGB and NIR image input in an end-to-end manner. The network performs pose regression to generate a plant location likelihood map. Our approach allows us to cope with visual variances of plants both for different species and different growth stages. We achieve high localization accuracies as shown in detailed evaluations of a sugar beet cultivation phase. In experiments with our BoniRob we demonstrate that detections can be robustly reproduced with centimeter accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionSimilar Papers 제목 키워드 기반
Fully automated workflow for designing patient-specific orthopaedic implants: application to total knee arthroplasty
Background. Osteoarthritis affects about 528 million people worldwide, causing pain and stiffness in the joints. Arthroplasty is commonly performed to treat joint osteoarthritis, reducing pain and improving mobility. Nev…
AnatomyClustering Techniques for Stable Linear Dynamical Systems with applications to Hard Disk Drives
In Robust Control and Data Driven Robust Control design methodologies, multiple plant transfer functions or a family of transfer functions are considered and a common controller is designed such that all the plants that …
ClusteringDomain-invariant NBV Planner for Active Cross-domain Self-localization
Pole-like landmark has received increasing attention as a domain-invariant visual cue for visual robot self-localization across domains (e.g., seasons, times of day, weathers). However, self-localization using pole-like …
Deep Reinforcement LearningStable compensators in parallel to stabilize arbitrary proper rational SISO plants
We consider stabilization of linear time-invariant (LTI) and single input single output (SISO) plants in the frequency domain from a fresh perspective. Compensators that are themselves stable are sometimes preferred beca…
Biogenic magnetic nanoparticles in plants
The genetic programming of biosynthesis of biogenic magnetic nanoparticles (BMNs) in plants was revealed by methods of comparative genomics. The samples of leaves and the root of Nicotiana tabacum, the stems and tubers o…