A Relation-Augmented Fully Convolutional Network for Semantic Segmentation in Aerial Scenes
Most current semantic segmentation approaches fall back on deep convolutional neural networks (CNNs). However, their use of convolution operations with local receptive fields causes failures in modeling contextual spatial relations. Prior works have sought to address this issue by using graphical models or spatial propagation modules in networks. But such models often fail to capture long-range spatial relationships between entities, which leads to spatially fragmented predictions. Moreover, recent works have demonstrated that channel-wise information also acts a pivotal part in CNNs. In this work, we introduce two simple yet effective network units, the spatial relation module and the channel relation module, to learn and reason about global relationships between any two spatial positions or feature maps, and then produce relation-augmented feature representations. The spatial and channel relation modules are general and extensible, and can be used in a plug-and-play fashion with the existing fully convolutional network (FCN) framework. We evaluate relation module-equipped networks on semantic segmentation tasks using two aerial image datasets, which fundamentally depend on long-range spatial relational reasoning. The networks achieve very competitive results, bringing significant improvements over baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
RelationRelational ReasoningSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pixel-level Encoding and Depth Layering for Instance-level Semantic Labeling
Recent approaches for instance-aware semantic labeling have augmented convolutional neural networks (CNNs) with complex multi-task architectures or computationally expensive graphical models. We present a method that lev…
Instance SegmentationSemantic SegmentationFuzzy Semantic Segmentation of Breast Ultrasound Image with Breast Anatomy Constraints
Breast cancer is one of the most serious disease affecting women's health. Due to low cost, portable, no radiation, and high efficiency, breast ultrasound (BUS) imaging is the most popular approach for diagnosing early b…
AnatomyImage AugmentationSemantic SegmentationAdaptive feature recombination and recalibration for semantic segmentation with Fully Convolutional Networks
Fully Convolutional Networks have been achieving remarkable results in image semantic segmentation, while being efficient. Such efficiency results from the capability of segmenting several voxels in a single forward pass…
Brain Tumor Segmentationimage-classificationImage ClassificationSegmentation+2CFNet: Learning Correlation Functions for One-Stage Panoptic Segmentation
Recently, there is growing attention on one-stage panoptic segmentation methods which aim to segment instances and stuff jointly within a fully convolutional pipeline efficiently. However, most of the existing works dire…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationBiSeg: Simultaneous Instance Segmentation and Semantic Segmentation with Fully Convolutional Networks
We present a simple and effective framework for simultaneous semantic segmentation and instance segmentation with Fully Convolutional Networks (FCNs). The method, called BiSeg, predicts instance segmentation as a posteri…
Bayesian InferenceInstance SegmentationPositionSegmentation+1