Exploiting Boundary Loss for the Hierarchical Panoptic Segmentation of Plants and Leaves
Precision agriculture leverages data and machine learning so that farmers can monitor their crops and target interventions precisely. This enables the precision application of herbicide only to weeds, or the precision application of fertilizer only to undernourished crops, rather than to the entire field. The approach promises to maximize yields while minimizing resource use and harm to the surrounding environment. To this end, we propose a hierarchical panoptic segmentation method that simultaneously determines leaf count (as an identifier of plant growth)and locates weeds within an image. In particular, our approach aims to improve the segmentation of smaller instances like the leaves and weeds by incorporating focal loss and boundary loss. Not only does this result in competitive performance, achieving a PQ+ of 81.89 on the standard training set, but we also demonstrate we can improve leaf-counting accuracy with our method. The code is available at https://github.com/madeleinedarbyshire/HierarchicalMask2Former.
Code (1)
Tasks
Panoptic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hierarchical Lovász Embeddings for Proposal-free Panoptic Segmentation
Panoptic segmentation brings together two separate tasks: instance and semantic segmentation. Although they are related, unifying them faces an apparent paradox: how to learn simultaneously instance-specific and category…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationHierarchical Lovasz Embeddings for Proposal-Free Panoptic Segmentation
Panoptic segmentation brings together two separate tasks: instance and semantic segmentation. Although they are related, unifying them faces an apparent paradox: how to learn simultaneously instance-specific and cate…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationA Good Foundation is Worth Many Labels: Label-Efficient Panoptic Segmentation
A key challenge for the widespread application of learning-based models for robotic perception is to significantly reduce the required amount of annotated training data while achieving accurate predictions. This is essen…
Autonomous DrivingBoundary DetectionDescriptivePanoptic Segmentation+2Scene-Centric Unsupervised Video Panoptic Segmentation
Video panoptic segmentation (VPS) aims to jointly detect, segment, and track all objects while partitioning the video into semantically consistent regions. We introduce the task setting of unsupervised VPS, omitting any …
Video Panoptic SegmentationScene UnderstandingVideo SegmentationImage SegmentationBoundary IoU: Improving Object-Centric Image Segmentation Evaluation
We present Boundary IoU (Intersection-over-Union), a new segmentation evaluation measure focused on boundary quality. We perform an extensive analysis across different error types and object sizes and show that Boundary …
Image SegmentationObjectPanoptic SegmentationSegmentation+1