Self-Constructing Graph Convolutional Networks for Semantic Labeling
Graph Neural Networks (GNNs) have received increasing attention in many fields. However, due to the lack of prior graphs, their use for semantic labeling has been limited. Here, we propose a novel architecture called the Self-Constructing Graph (SCG), which makes use of learnable latent variables to generate embeddings and to self-construct the underlying graphs directly from the input features without relying on manually built prior knowledge graphs. SCG can automatically obtain optimized non-local context graphs from complex-shaped objects in aerial imagery. We optimize SCG via an adaptive diagonal enhancement method and a variational lower bound that consists of a customized graph reconstruction term and a Kullback-Leibler divergence regularization term. We demonstrate the effectiveness and flexibility of the proposed SCG on the publicly available ISPRS Vaihingen dataset and our model SCG-Net achieves competitive results in terms of F1-score with much fewer parameters and at a lower computational cost compared to related pure-CNN based work. Our code will be made public soon.
Code (1)
Tasks
Graph ReconstructionKnowledge GraphsSimilar Papers 제목 키워드 기반
Multi-view Self-Constructing Graph Convolutional Networks with Adaptive Class Weighting Loss for Semantic Segmentation
We propose a novel architecture called the Multi-view Self-Constructing Graph Convolutional Networks (MSCG-Net) for semantic segmentation. Building on the recently proposed Self-Constructing Graph (SCG) module, which mak…
Knowledge GraphsSemantic SegmentationSCG-Net: Self-Constructing Graph Neural Networks for Semantic Segmentation
Capturing global contextual representations by exploiting long-range pixel-pixel dependencies has shown to improve semantic segmentation performance. However, how to do this efficiently is an open question as current app…
Graph ReconstructionOpen-Ended Question AnsweringSegmentationSemantic SegmentationSemantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network
Semantic labeling for very high resolution (VHR) images in urban areas, is of significant importance in a wide range of remote sensing applications. However, many confusing manmade objects and intricate fine-structured o…
Pixel-level Encoding and Depth Layering for Instance-level Semantic Labeling
Recent approaches for instance-aware semantic labeling have augmented convolutional neural networks (CNNs) with complex multi-task architectures or computationally expensive graphical models. We present a method that lev…
Instance SegmentationSemantic SegmentationIncorporating Deep Syntactic and Semantic Knowledge for Chinese Sequence Labeling with GCN
Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded…
Chinese Word SegmentationPart-Of-Speech TaggingSemantic Parsing