CG-Net: Conditional GIS-aware Network for Individual Building Segmentation in VHR SAR Images
Object retrieval and reconstruction from very high resolution (VHR) synthetic aperture radar (SAR) images are of great importance for urban SAR applications, yet highly challenging owing to the complexity of SAR data. This paper addresses the issue of individual building segmentation from a single VHR SAR image in large-scale urban areas. To achieve this, we introduce building footprints from GIS data as complementary information and propose a novel conditional GIS-aware network (CG-Net). The proposed model learns multi-level visual features and employs building footprints to normalize the features for predicting building masks in the SAR image. We validate our method using a high resolution spotlight TerraSAR-X image collected over Berlin. Experimental results show that the proposed CG-Net effectively brings improvements with variant backbones. We further compare two representations of building footprints, namely complete building footprints and sensor-visible footprint segments, for our task, and conclude that the use of the former leads to better segmentation results. Moreover, we investigate the impact of inaccurate GIS data on our CG-Net, and this study shows that CG-Net is robust against positioning errors in GIS data. In addition, we propose an approach of ground truth generation of buildings from an accurate digital elevation model (DEM), which can be used to generate large-scale SAR image datasets. The segmentation results can be applied to reconstruct 3D building models at level-of-detail (LoD) 1, which is demonstrated in our experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSegmentationSimilar Papers 제목 키워드 기반
A Shared Representation for Photorealistic Driving Simulators
A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Ne…
Autonomous VehiclesImage GenerationScene SegmentationSemantic SegmentationParsing World's Skylines using Shape-Constrained MRFs
We propose an approach for segmenting the individual buildings in typical skyline images. Our approach is based on a Markov Random Field (MRF) formulation that exploits the fact that such images contain overlapping objec…
SegmentationInstance segmentation of buildings using keypoints
Building segmentation is of great importance in the task of remote sensing imagery interpretation. However, the existing semantic segmentation and instance segmentation methods often lead to segmentation masks with blurr…
Instance SegmentationSegmentationSemantic SegmentationAutomated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiative
In medical image analysis, automated segmentation of multi-component anatomical structures, which often have a spectrum of potential anomalies and pathologies, is a challenging task. In this work, we develop a multi-step…
Anomaly DetectionMedical Image AnalysisSegmentationSemantic Segmentation+1Gastric histopathology image segmentation using a hierarchical conditional random field
For the Convolutional Neural Networks (CNNs) applied in the intelligent diagnosis of gastric cancer, existing methods mostly focus on individual characteristics or network frameworks without a policy to depict the integr…
Blood DetectionImage SegmentationSegmentationSemantic Segmentation+1