Foreground-Aware Relation Network for Geospatial Object Segmentation in High Spatial Resolution Remote Sensing Imagery
Geospatial object segmentation, as a particular semantic segmentation task, always faces with larger-scale variation, larger intra-class variance of background, and foreground-background imbalance in the high spatial resolution (HSR) remote sensing imagery. However, general semantic segmentation methods mainly focus on scale variation in the natural scene, with inadequate consideration of the other two problems that usually happen in the large area earth observation scene. In this paper, we argue that the problems lie on the lack of foreground modeling and propose a foreground-aware relation network (FarSeg) from the perspectives of relation-based and optimization-based foreground modeling, to alleviate the above two problems. From perspective of relation, FarSeg enhances the discrimination of foreground features via foreground-correlated contexts associated by learning foreground-scene relation. Meanwhile, from perspective of optimization, a foreground-aware optimization is proposed to focus on foreground examples and hard examples of background during training for a balanced optimization. The experimental results obtained using a large scale dataset suggest that the proposed method is superior to the state-of-the-art general semantic segmentation methods and achieves a better trade-off between speed and accuracy. Code has been made available at: \url{https://github.com/Z-Zheng/FarSeg}.
Code (2)
Tasks
Earth ObservationRelationRelation NetworkSegmentationSemantic SegmentationThe Semantic Segmentation Of Remote Sensing ImagerySimilar Papers 제목 키워드 기반
FarSeg++: Foreground-Aware Relation Network for Geospatial Object Segmentation in High Spatial Resolution Remote Sensing Imagery
Geospatial object segmentation, a fundamental Earth vision task, always suffers from scale variation, the larger intraclass variance of background, and foreground-background imbalance in high spatial resolution (HSR) rem…
Earth ObservationRelationRelation NetworkSegmentation+2Sparse and Complete Latent Organization for Geospatial Semantic Segmentation
Geospatial semantic segmentation on remote sensing images suffers from large intra-class variance in both foreground and background classes. First, foreground objects are tiny in the remote sensing images and are rep…
Contrastive LearningSemantic SegmentationFOCUS: Towards Universal Foreground Segmentation
Foreground segmentation is a fundamental task in computer vision, encompassing various subdivision tasks. Previous research has typically designed task-specific architectures for each task, leading to a lack of unificati…
Camouflaged Object SegmentationDefocus Blur DetectionForeground SegmentationSalient Object Detection+2Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature Contrast
Contrastive learning has recently demonstrated great potential for unsupervised pre-training in 3D scene understanding tasks. However, most existing work randomly selects point features as anchors while building contrast…
3D Semantic SegmentationContrastive LearningInstance Segmentationobject-detection+7Key-Word-Aware Network for Referring Expression Image Segmentation
Referring expression image segmentation aims to segment out the object referred by a natural language query expression. Without considering the specific properties of visual and textual information, existing works usuall…
Image SegmentationObjectReferring ExpressionSemantic Segmentation