paper-with-me

홈 › Papers

UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes

2025-11-28 · Shuo Ni, Di Wang, He Chen, Haonan Guo, Ning Zhang, Jing Zhang arxiv

Instruction-driven segmentation in remote sensing generates masks from guidance, offering great potential for accessible and generalizable applications. However, existing methods suffer from fragmented task formulations and limited instruction data, hindering effective understanding and generalization. To address these issues, we introduce GeoSeg-1M, the first million-scale dataset for remote sensing instruction-driven segmentation, constructed via an automatic mask filtering and instruction generation pipeline that synthesizes referring, interactive, and reasoning segmentation instructions from multiple public datasets. GeoSeg-1M contains 590K images, 117 categories, and 1.1M image-mask-instruction triplets. Building upon this foundation, we further curate GeoSeg-Bench, a challenging benchmark designed to evaluate contextual understanding and reasoning capabilities across diverse instruction-driven tasks and complex geospatial scenes. Furthermore, we present UniGeoSeg, a unified framework that serves as a strong baseline, incorporating task-aware text enhancement, latent knowledge memory, and a progressive training strategy to facilitate multi-task learning. Extensive experiments demonstrate the state-of-the-art performance of UniGeoSeg across GeoSeg-Bench and diverse public benchmarks, while exhibiting strong zero-shot generalization. Datasets and source code were released at https://github.com/MiliLab/UniGeoSeg.

📄 PDF Abstract BibTeX arXiv:2511.23332

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot GeneralizationMulti-Task Learning

Similar Papers 제목 키워드 기반

Geospatial-Reasoning-Driven Vocabulary-Agnostic Remote Sensing Semantic Segmentation

2026-02-09 · Chufeng Zhou, Jian Wang, Xinyuan Liu, Xiaokang Zhang arxiv

Open-vocabulary semantic segmentation has become an important direction in remote sensing, as it enables recognition beyond predefined land-cover categories. However, existing methods mainly depend on passive visual-text…

Knowledge DistillationSemantic Segmentation

GeoSANE: Learning Geospatial Representations from Models, Not Data

2026-03-24 · Joelle Hanna, Damian Falk, Stella X. Yu, Damian Borth arxiv

Recent advances in remote sensing have led to an increase in the number of available foundation models; each trained on different modalities, datasets, and objectives, yet capturing only part of the vast geospatial knowl…

Knowledge Distillation

PRUE: A Practical Recipe for Field Boundary Segmentation at Scale

2026-03-28 · Gedeon Muhawenayo, Caleb Robinson, Subash Khanal, Zhanpei Fang 외 arxiv

Large-scale maps of field boundaries are essential for agricultural monitoring tasks. Existing deep learning approaches for satellite-based field mapping are sensitive to illumination, spatial scale, and changes in geogr…

Semantic Segmentation

LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery

2025-05-05 · Jerome Quenum, Wen-Han Hsieh, Tsung-Han Wu, Ritwik Gupta 외

Segmentation models can recognize a pre-defined set of objects in images. However, models that can reason over complex user queries that implicitly refer to multiple objects of interest are still in their infancy. Recent…

Reasoning SegmentationSegmentation

Unified Open-World Segmentation with Multi-Modal Prompts

2025-10-12 · Yang Liu, Yufei Yin, Chenchen Jing, Muzhi Zhu 외 arxiv

In this work, we present COSINE, a unified open-world segmentation model that consolidates open-vocabulary segmentation and in-context segmentation with multi-modal prompts (e.g., text and image). COSINE exploits foundat…

Representation Learning