Structure-measure: A New Way to Evaluate Foreground Maps
Foreground map evaluation is crucial for gauging the progress of object segmentation algorithms, in particular in the filed of salient object detection where the purpose is to accurately detect and segment the most salient object in a scene. Several widely-used measures such as Area Under the Curve (AUC), Average Precision (AP) and the recently proposed Fbw have been utilized to evaluate the similarity between a non-binary saliency map (SM) and a ground-truth (GT) map. These measures are based on pixel-wise errors and often ignore the structural similarities. Behavioral vision studies, however, have shown that the human visual system is highly sensitive to structures in scenes. Here, we propose a novel, efficient, and easy to calculate measure known an structural similarity measure (Structure-measure) to evaluate non-binary foreground maps. Our new measure simultaneously evaluates region-aware and object-aware structural similarity between a SM and a GT map. We demonstrate superiority of our measure over existing ones using 5 meta-measures on 5 benchmark datasets.
Code (1)
Tasks
Objectobject-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSemantic SegmentationSmall Object DetectionVideo Object DetectionVideo Salient Object DetectionSimilar Papers 제목 키워드 기반
How to Evaluate Foreground Maps?
The output of many algorithms in computer-vision is either non-binary maps or binary maps (e.g., salient object detection and object segmentation). Several measures have been suggested to evaluate the accuracy of these f…
object-detectionObject DetectionRGB Salient Object DetectionSalient Object Detection+2Salient Object Detection via Objectness Measure
Salient object detection has become an important task in many image processing applications. The existing approaches exploit background prior and contrast prior to attain state of the art results. In this paper, instead …
Objectobject-detectionObject DetectionRGB Salient Object Detection+1Pixel Objectness
We propose an end-to-end learning framework for generating foreground object segmentations. Given a single novel image, our approach produces pixel-level masks for all "object-like" regions---even for object categories n…
Foreground SegmentationImage RetargetingImage RetrievalObject+3Saliency-Aware Geodesic Video Object Segmentation
We introduce an unsupervised, geodesic distance based, salient video object segmentation method. Unlike traditional methods, our method incorporates saliency as prior for object via the computation of robust geodesic mea…
ObjectSegmentationSemantic SegmentationVideo Object Segmentation+2MapReader: A Computer Vision Pipeline for the Semantic Exploration of Maps at Scale
We present MapReader, a free, open-source software library written in Python for analyzing large map collections (scanned or born-digital). This library transforms the way historians can use maps by turning extensive, ho…
16kImage Classification