Guided Upsampling Network for Real-Time Semantic Segmentation
Semantic segmentation architectures are mainly built upon an encoder-decoder structure. These models perform subsequent downsampling operations in the encoder. Since operations on high-resolution activation maps are computationally expensive, usually the decoder produces output segmentation maps by upsampling with parameters-free operators like bilinear or nearest-neighbor. We propose a Neural Network named Guided Upsampling Network which consists of a multiresolution architecture that jointly exploits high-resolution and large context information. Then we introduce a new module named Guided Upsampling Module (GUM) that enriches upsampling operators by introducing a learnable transformation for semantic maps. It can be plugged into any existing encoder-decoder architecture with little modifications and low additional computation cost. We show with quantitative and qualitative experiments how our network benefits from the use of GUM module. A comprehensive set of experiments on the publicly available Cityscapes dataset demonstrates that Guided Upsampling Network can efficiently process high-resolution images in real-time while attaining state-of-the art performances.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderReal-Time Semantic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Location-aware Upsampling for Semantic Segmentation
Many successful learning targets such as minimizing dice loss and cross-entropy loss have enabled unprecedented breakthroughs in segmentation tasks. Beyond these semantic metrics, this paper aims to introduce location su…
DecoderSegmentationSemantic SegmentationAlphaNet: An Attention Guided Deep Network for Automatic Image Matting
In this paper, we propose an end to end solution for image matting i.e high-precision extraction of foreground objects from natural images. Image matting and background detection can be achieved easily through chroma key…
Image MattingSegmentationSemantic Image MattingSemantic SegmentationAUNet: Attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms
Mammography is one of the most commonly applied tools for early breast cancer screening. Automatic segmentation of breast masses in mammograms is essential but challenging due to the low signal-to-noise ratio and the wid…
Breast Mass Segmentation In Whole MammogramsDecoderSegmentationAURASeg: Attention-Guided Upsampling with Residual-Assisted Boundary Refinement for Drivable-Area Segmentation
Free-space segmentation is essential for autonomous robots to identify drivable regions and navigate safely across indoor, outdoor, and road-scene environments. However, conventional encoder-decoder models often recover …
Spatial Sampling Network for Fast Scene Understanding
We propose a network architecture to perform efficient scene understanding. This work presents three main novelties: the first is an Improved Guided Upsampling Module that can replace in toto the decoder part in common s…
DecoderInstance SegmentationScene UnderstandingSegmentation+1