Evaluating Bayesian Deep Learning Methods for Semantic Segmentation
Deep learning has been revolutionary for computer vision and semantic segmentation in particular, with Bayesian Deep Learning (BDL) used to obtain uncertainty maps from deep models when predicting semantic classes. This information is critical when using semantic segmentation for autonomous driving for example. Standard semantic segmentation systems have well-established evaluation metrics. However, with BDL's rising popularity in computer vision we require new metrics to evaluate whether a BDL method produces better uncertainty estimates than another method. In this work we propose three such metrics to evaluate BDL models designed specifically for the task of semantic segmentation. We modify DeepLab-v3+, one of the state-of-the-art deep neural networks, and create its Bayesian counterpart using MC dropout and Concrete dropout as inference techniques. We then compare and test these two inference techniques on the well-known Cityscapes dataset using our suggested metrics. Our results provide new benchmarks for researchers to compare and evaluate their improved uncertainty quantification in pursuit of safer semantic segmentation.
Code (1)
Tasks
Anomaly DetectionAutonomous DrivingDeep LearningSegmentationSemantic SegmentationUncertainty QuantificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Evaluating Uncertainty Estimation Methods on 3D Semantic Segmentation of Point Clouds
Deep learning models are extensively used in various safety critical applications. Hence these models along with being accurate need to be highly reliable. One way of achieving this is by quantifying uncertainty. Bayesia…
3D Semantic SegmentationDecision MakingSemantic SegmentationUncertainty QuantificationBiSeg: Simultaneous Instance Segmentation and Semantic Segmentation with Fully Convolutional Networks
We present a simple and effective framework for simultaneous semantic segmentation and instance segmentation with Fully Convolutional Networks (FCNs). The method, called BiSeg, predicts instance segmentation as a posteri…
Bayesian InferenceInstance SegmentationPositionSegmentation+1Bayesian Semantic Instance Segmentation in Open Set World
This paper addresses the semantic instance segmentation task in the open-set conditions, where input images can contain known and unknown object classes. The training process of existing semantic instance segmentation me…
Instance SegmentationObjectSegmentationSemantic SegmentationBayesian Generative Models for Knowledge Transfer in MRI Semantic Segmentation Problems
Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which ar…
Brain Tumor SegmentationSegmentationSemantic SegmentationTransfer Learning+1Bayesian Generative Models for Knowledge Transfer in MRI Semantic Segmentation Problems
Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which ar…
Brain Tumor SegmentationSegmentationSemantic SegmentationTransfer Learning+1