RRSIS: Referring Remote Sensing Image Segmentation
Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in natural images. However, almost no research attention is given to this task of remote sensing imagery. Considering its potential for real-world applications, in this paper, we introduce referring remote sensing image segmentation (RRSIS) to fill in this gap and make some insightful explorations. Specifically, we create a new dataset, called RefSegRS, for this task, enabling us to evaluate different methods. Afterward, we benchmark referring image segmentation methods of natural images on the RefSegRS dataset and find that these models show limited efficacy in detecting small and scattered objects. To alleviate this issue, we propose a language-guided cross-scale enhancement (LGCE) module that utilizes linguistic features to adaptively enhance multi-scale visual features by integrating both deep and shallow features. The proposed dataset, benchmarking results, and the designed LGCE module provide insights into the design of a better RRSIS model. We will make our dataset and code publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingImage SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Exploring Fine-Grained Image-Text Alignment for Referring Remote Sensing Image Segmentation
Given a language expression, referring remote sensing image segmentation (RRSIS) aims to identify ground objects and assign pixel-wise labels within the imagery. The one of key challenges for this task is to capture disc…
Image SegmentationReferring ExpressionSemantic SegmentationUnderstanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressions
Referring Remote Sensing Image Segmentation (RRSIS) aims to segment instances in remote sensing images according to referring expressions. Unlike Referring Image Segmentation on general images, acquiring high-quality ref…
Referring ExpressionImage SegmentationCustomized SAM 2 for Referring Remote Sensing Image Segmentation
Referring Remote Sensing Image Segmentation (RRSIS) aims to segment target objects in remote sensing (RS) images based on textual descriptions. Although Segment Anything Model 2 (SAM 2) has shown remarkable performance i…
Image SegmentationSegmentationSemantic SegmentationCADFormer: Fine-Grained Cross-modal Alignment and Decoding Transformer for Referring Remote Sensing Image Segmentation
Referring Remote Sensing Image Segmentation (RRSIS) is a challenging task, aiming to segment specific target objects in remote sensing (RS) images based on a given language expression. Existing RRSIS methods typically em…
cross-modal alignmentImage SegmentationSemantic SegmentationCross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation
Given a natural language expression and a remote sensing image, the goal of referring remote sensing image segmentation (RRSIS) is to generate a pixel-level mask of the target object identified by the referring expressio…
BenchmarkingImage SegmentationReferring ExpressionSemantic Segmentation