paper-with-me

Papers

Biomass phenotyping of oilseed rape through UAV multi-view oblique imaging with 3DGS and SAM model

2024-11-13 · YuTao Shen, HongYu Zhou, Xin Yang, Xuqi Lu, Ziyue Guo, Lixi Jiang, Yong He, Haiyan Cen

Biomass estimation of oilseed rape is crucial for optimizing crop productivity and breeding strategies. While UAV-based imaging has advanced high-throughput phenotyping, current methods often rely on orthophoto images, which struggle with overlapping leaves and incomplete structural information in complex field environments. This study integrates 3D Gaussian Splatting (3DGS) with the Segment Anything Model (SAM) for precise 3D reconstruction and biomass estimation of oilseed rape. UAV multi-view oblique images from 36 angles were used to perform 3D reconstruction, with the SAM module enhancing point cloud segmentation. The segmented point clouds were then converted into point cloud volumes, which were fitted to ground-measured biomass using linear regression. The results showed that 3DGS (7k and 30k iterations) provided high accuracy, with peak signal-to-noise ratios (PSNR) of 27.43 and 29.53 and training times of 7 and 49 minutes, respectively. This performance exceeded that of structure from motion (SfM) and mipmap Neural Radiance Fields (Mip-NeRF), demonstrating superior efficiency. The SAM module achieved high segmentation accuracy, with a mean intersection over union (mIoU) of 0.961 and an F1-score of 0.980. Additionally, a comparison of biomass extraction models found the point cloud volume model to be the most accurate, with an determination coefficient (R2) of 0.976, root mean square error (RMSE) of 2.92 g/plant, and mean absolute percentage error (MAPE) of 6.81%, outperforming both the plot crop volume and individual crop volume models. This study highlights the potential of combining 3DGS with multi-view UAV imaging for improved biomass phenotyping.

📄 PDF Abstract BibTeX arXiv:2411.08453

Code (0)

등록된 구현이 없습니다.

Tasks

3DGS3D ReconstructionNeRFPoint Cloud Segmentation

Methods 이 논문이 사용한 방법론

SAM 설명 없음

Similar Papers 제목 키워드 기반

In-field high throughput grapevine phenotyping with a consumer-grade depth camera

2021-04-14 · Annalisa Milella, Roberto Marani, Antonio Petitti, Giulio Reina

Plant phenotyping, that is, the quantitative assessment of plant traits including growth, morphology, physiology, and yield, is a critical aspect towards efficient and effective crop management. Currently, plant phenotyp…

ManagementPlant PhenotypingVocal Bursts Intensity Prediction

Axis-Aligned 3D Stalk Diameter Estimation from RGB-D Imagery

2025-09-15 · Benjamin Vail, Rahul Harsha Cheppally, Ajay Sharda, Sidharth Rai arxiv

Accurate, high-throughput phenotyping is a critical component of modern crop breeding programs, especially for improving traits such as mechanical stability, biomass production, and disease resistance. Stalk diameter is …

Instance Segmentation

Semantic Image Segmentation with Deep Learning for Vine Leaf Phenotyping

2022-10-24 · Petros N. Tamvakis, Chairi Kiourt, Alexandra D. Solomou, George Ioannakis 외

Plant phenotyping refers to a quantitative description of the plants properties, however in image-based phenotyping analysis, our focus is primarily on the plants anatomical, ontogenetical and physiological properties.Th…

Deep LearningImage Segmentationobject-detectionObject Detection+2

Estimating Phenotypic Traits From UAV Based RGB Imagery

2018-07-02 · Javier Ribera, Fangning He, Yuhao Chen, Ayman F. Habib 외

In many agricultural applications one wants to characterize physical properties of plants and use the measurements to predict, for example biomass and environmental influence. This process is known as phenotyping. Tradit…

Position

An Adaptive Approach for Automated Grapevine Phenotyping using VGG-based Convolutional Neural Networks

2018-11-23 · Jonatan Grimm, Katja Herzog, Florian Rist, Anna Kicherer 외

In (grapevine) breeding programs and research, periodic phenotyping and multi-year monitoring of different grapevine traits, like growth or yield, is needed especially in the field. This demand imply objective, precise a…

Objectobject-detectionObject Detection