Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection
We present an end-to-end trainable deep convolutional neural network (DCNN) for semantic segmentation with built-in awareness of semantically meaningful boundaries. Semantic segmentation is a fundamental remote sensing task, and most state-of-the-art methods rely on DCNNs as their workhorse. A major reason for their success is that deep networks learn to accumulate contextual information over very large windows (receptive fields). However, this success comes at a cost, since the associated loss of effecive spatial resolution washes out high-frequency details and leads to blurry object boundaries. Here, we propose to counter this effect by combining semantic segmentation with semantically informed edge detection, thus making class-boundaries explicit in the model, First, we construct a comparatively simple, memory-efficient model by adding boundary detection to the Segnet encoder-decoder architecture. Second, we also include boundary detection in FCN-type models and set up a high-end classifier ensemble. We show that boundary detection significantly improves semantic segmentation with CNNs. Our high-end ensemble achieves > 90% overall accuracy on the ISPRS Vaihingen benchmark.
Code (1)
Tasks
Boundary DetectionDecoderEdge DetectionGeneral ClassificationImage SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Boundary-rendering network for breast lesion segmentation in ultrasound images
Breast Ultrasound (BUS) has proven to be an effective tool for the early detection of cancer in the breast. A lesion segmentation provides identification of the boundary, shape, and location of the target, and serves …
Lesion SegmentationSegmentationSemantic SegmentationBoundary Corrected Multi-scale Fusion Network for Real-time Semantic Segmentation
Image semantic segmentation aims at the pixel-level classification of images, which has requirements for both accuracy and speed in practical application. Existing semantic segmentation methods mainly rely on the high-re…
Real-Time Semantic SegmentationScene ParsingSegmentationSemantic SegmentationAttention-based fusion of semantic boundary and non-boundary information to improve semantic segmentation
This paper introduces a method for image semantic segmentation grounded on a novel fusion scheme, which takes place inside a deep convolutional neural network. The main goal of our proposal is to explore object boundary …
Boundary DetectionSegmentationSemantic SegmentationBoundary Knowledge Translation based Reference Semantic Segmentation
Given a reference object of an unknown type in an image, human observers can effortlessly find the objects of the same category in another image and precisely tell their visual boundaries. Such visual cognition capabilit…
SegmentationSemantic SegmentationTranslationEnd-to-End Boundary Aware Networks for Medical Image Segmentation
Fully convolutional neural networks (CNNs) have proven to be effective at representing and classifying textural information, thus transforming image intensity into output class masks that achieve semantic image segmentat…
Brain Tumor SegmentationImage SegmentationMedical Image AnalysisMedical Image Segmentation+3