Boundary IoU: Improving Object-Centric Image Segmentation Evaluation
We present Boundary IoU (Intersection-over-Union), a new segmentation evaluation measure focused on boundary quality. We perform an extensive analysis across different error types and object sizes and show that Boundary IoU is significantly more sensitive than the standard Mask IoU measure to boundary errors for large objects and does not over-penalize errors on smaller objects. The new quality measure displays several desirable characteristics like symmetry w.r.t. prediction/ground truth pairs and balanced responsiveness across scales, which makes it more suitable for segmentation evaluation than other boundary-focused measures like Trimap IoU and F-measure. Based on Boundary IoU, we update the standard evaluation protocols for instance and panoptic segmentation tasks by proposing the Boundary AP (Average Precision) and Boundary PQ (Panoptic Quality) metrics, respectively. Our experiments show that the new evaluation metrics track boundary quality improvements that are generally overlooked by current Mask IoU-based evaluation metrics. We hope that the adoption of the new boundary-sensitive evaluation metrics will lead to rapid progress in segmentation methods that improve boundary quality.
Code (2)
Tasks
Image SegmentationObjectPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
OTAS: Unsupervised Boundary Detection for Object-Centric Temporal Action Segmentation
Temporal action segmentation is typically achieved by discovering the dramatic variances in global visual descriptors. In this paper, we explore the merits of local features by proposing the unsupervised framework of Obj…
Action SegmentationBoundary DetectionSegmentationTemporal Action SegmentationIterative Next Boundary Detection for Instance Segmentation of Tree Rings in Microscopy Images of Shrub Cross Sections
We address the problem of detecting tree rings in microscopy images of shrub cross sections. This can be regarded as a special case of the instance segmentation task with several unique challenges such as the concentric …
Boundary DetectionInstance SegmentationSegmentationSemantic SegmentationSAM2-3dMed: Empowering SAM2 for 3D Medical Image Segmentation
Accurate segmentation of 3D medical images is critical for clinical applications like disease assessment and treatment planning. While the Segment Anything Model 2 (SAM2) has shown remarkable success in video object segm…
Medical Image SegmentationVideo Object SegmentationBoundary DetectionObject Detection Free Instance Segmentation With Labeling Transformations
Instance segmentation has attracted recent attention in computer vision and existing methods in this domain mostly have an object detection stage. In this paper, we study the intrinsic challenge of the instance segmentat…
Instance SegmentationObjectobject-detectionObject Detection+2unMORE: Unsupervised Multi-Object Segmentation via Center-Boundary Reasoning
We study the challenging problem of unsupervised multi-object segmentation on single images. Existing methods, which rely on image reconstruction objectives to learn objectness or leverage pretrained image features to gr…
Image ReconstructionObjectSemantic Segmentation