How to Evaluate Foreground Maps?
The output of many algorithms in computer-vision is either non-binary maps or binary maps (e.g., salient object detection and object segmentation). Several measures have been suggested to evaluate the accuracy of these foreground maps. In this paper, we show that the most commonly-used measures for evaluating both non-binary maps and binary maps do not always provide a reliable evaluation. This includes the Area-Under-the-Curve measure, the Average-Precision measure, the F-measure, and the evaluation measure of the PASCAL VOC segmentation challenge. We start by identifying three causes of inaccurate evaluation. We then propose a new measure that amends these flaws. An appealing property of our measure is being an intuitive generalization of the F-measure. Finally we propose four meta-measures to compare the adequacy of evaluation measures. We show via experiments that our novel measure is preferable.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Salient Object Detection via Objectness Measure
Salient object detection has become an important task in many image processing applications. The existing approaches exploit background prior and contrast prior to attain state of the art results. In this paper, instead …
Objectobject-detectionObject DetectionRGB Salient Object Detection+1Structure-measure: A New Way to Evaluate Foreground Maps
Foreground map evaluation is crucial for gauging the progress of object segmentation algorithms, in particular in the filed of salient object detection where the purpose is to accurately detect and segment the most salie…
Objectobject-detectionObject DetectionRGB Salient Object Detection+5Cell Instance Segmentation: The Devil Is in the Boundaries
State-of-the-art (SOTA) methods for cell instance segmentation are based on deep learning (DL) semantic segmentation approaches, focusing on distinguishing foreground pixels from background pixels. In order to identify c…
Semantic SegmentationInstance SegmentationPixel Objectness
We propose an end-to-end learning framework for generating foreground object segmentations. Given a single novel image, our approach produces pixel-level masks for all "object-like" regions---even for object categories n…
Foreground SegmentationImage RetargetingImage RetrievalObject+3Real-time Instance Segmentation with Discriminative Orientation Maps
Although instance segmentation has made considerable advancement over recent years, it's still a challenge to design high accuracy algorithms with real-time performance. In this paper, we propose a real-time instance seg…
Foreground SegmentationInstance SegmentationReal-time Instance SegmentationSegmentation+1