paper-with-me

Papers

Rethinking Semantic Segmentation Evaluation for Explainability and Model Selection

2021-01-21 · Yuxiang Zhang, Sachin Mehta, Anat Caspi

Semantic segmentation aims to robustly predict coherent class labels for entire regions of an image. It is a scene understanding task that powers real-world applications (e.g., autonomous navigation). One important application, the use of imagery for automated semantic understanding of pedestrian environments, provides remote mapping of accessibility features in street environments. This application (and others like it) require detailed geometric information of geographical objects. Semantic segmentation is a prerequisite for this task since it maps contiguous regions of the same class as single entities. Importantly, semantic segmentation uses like ours are not pixel-wise outcomes; however, most of their quantitative evaluation metrics (e.g., mean Intersection Over Union) are based on pixel-wise similarities to a ground-truth, which fails to emphasize over- and under-segmentation properties of a segmentation model. Here, we introduce a new metric to assess region-based over- and under-segmentation. We analyze and compare it to other metrics, demonstrating that the use of our metric lends greater explainability to semantic segmentation model performance in real-world applications.

📄 PDF Abstract BibTeX arXiv:2101.08418

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous NavigationModel SelectionScene UnderstandingSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Visual Prompt Selection for In-Context Learning Segmentation

2024-07-14 · Wei Suo, Lanqing Lai, Mengyang Sun, Hanwang Zhang 외

As a fundamental and extensively studied task in computer vision, image segmentation aims to locate and identify different semantic concepts at the pixel level. Recently, inspired by In-Context Learning (ICL), several ge…

DiversityImage SegmentationIn-Context LearningSegmentation+1

Rethinking the Evaluation of Visible and Infrared Image Fusion

2024-10-09 · Dayan Guan, Yixuan Wu, Tianzhu Liu, Alex C. Kot 외

Visible and Infrared Image Fusion (VIF) has garnered significant interest across a wide range of high-level vision tasks, such as object detection and semantic segmentation. However, the evaluation of VIF methods remains…

object-detectionObject DetectionSegmentationSemantic Segmentation+1

Toward Faithful Segmentation Attribution via Benchmarking and Dual-Evidence Fusion

2026-03-23 · Abu Noman Md Sakib, OFM Riaz Rahman Aranya, Kevin Desai, Zijie Zhang arxiv

Attribution maps for semantic segmentation are almost always judged by visual plausibility. Yet looking convincing does not guarantee that the highlighted pixels actually drive the model's prediction, nor that attributio…

Semantic Segmentation

Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Survey

2024-05-02 · Rokas Gipiškis, Chun-Wei Tsai, Olga Kurasova

Artificial Intelligence (XAI) has found numerous applications in computer vision. While image classification-based explainability techniques have garnered significant attention, their counterparts in semantic segmentatio…

image-classificationImage ClassificationImage SegmentationSegmentation+1

Every Component Counts: Rethinking the Measure of Success for Medical Semantic Segmentation in Multi-Instance Segmentation Tasks

2024-10-24 · Alexander Jaus, Constantin Seibold, Simon Reiß, Zdravko Marinov 외

We present Connected-Component~(CC)-Metrics, a novel semantic segmentation evaluation protocol, targeted to align existing semantic segmentation metrics to a multi-instance detection scenario in which each connected comp…

Instance SegmentationSegmentationSemantic Segmentation