paper-with-me

Papers

Reconciling Semantic Controllability and Diversity for Remote Sensing Image Synthesis with Hybrid Semantic Embedding

2024-11-22 · Junde Liu, Danpei Zhao, Bo Yuan, Wentao Li, Tian Li

Significant advancements have been made in semantic image synthesis in remote sensing. However, existing methods still face formidable challenges in balancing semantic controllability and diversity. In this paper, we present a Hybrid Semantic Embedding Guided Generative Adversarial Network (HySEGGAN) for controllable and efficient remote sensing image synthesis. Specifically, HySEGGAN leverages hierarchical information from a single source. Motivated by feature description, we propose a hybrid semantic Embedding method, that coordinates fine-grained local semantic layouts to characterize the geometric structure of remote sensing objects without extra information. Besides, a Semantic Refinement Network (SRN) is introduced, incorporating a novel loss function to ensure fine-grained semantic feedback. The proposed approach mitigates semantic confusion and prevents geometric pattern collapse. Experimental results indicate that the method strikes an excellent balance between semantic controllability and diversity. Furthermore, HySEGGAN significantly improves the quality of synthesized images and achieves state-of-the-art performance as a data augmentation technique across multiple datasets for downstream tasks.

📄 PDF Abstract BibTeX arXiv:2411.14781

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDiversityGenerative Adversarial NetworkImage Generation

Similar Papers 제목 키워드 기반

Exploring Text-Guided Single Image Editing for Remote Sensing Images

2024-05-09 · Fangzhou Han, Lingyu Si, Hongwei Dong, Lamei Zhang 외

Artificial intelligence generative content (AIGC) has significantly impacted image generation in the field of remote sensing. However, the equally important area of remote sensing image (RSI) editing has not received suf…

Image Generation

Feature Fusion Detector for Semantic Cognition of Remote Sensing

2019-09-28 · Wei Zhou, Yiying Li

The value of remote sensing images is of vital importance in many areas and needs to be refined by some cognitive approaches. The remote sensing detection is an appropriate way to achieve the semantic cognition. However,…

Diversity

Instance-aware Remote Sensing Image Captioning with Cross-hierarchy Attention

2021-05-11 · Chengze Wang, Zhiyu Jiang, Yuan Yuan

The spatial attention is a straightforward approach to enhance the performance for remote sensing image captioning. However, conventional spatial attention approaches consider only the attention distribution on one fixed…

DecoderDiversityImage Captioning

GAMUS: A Geometry-aware Multi-modal Semantic Segmentation Benchmark for Remote Sensing Data

2023-05-24 · Zhitong Xiong, Sining Chen, Yi Wang, Lichao Mou 외

Geometric information in the normalized digital surface models (nDSM) is highly correlated with the semantic class of the land cover. Exploiting two modalities (RGB and nDSM (height)) jointly has great potential to impro…

SegmentationSemantic Segmentation

Reducing Semantic Confusion: Scene-aware Aggregation Network for Remote Sensing Cross-modal Retrieval

2023-06-12 · ICMR 2023 6 · Jiancheng Pan, Qing Ma, Cong Bai

Recently, remote sensing cross-modal retrieval has received incredible attention from researchers. However, the unique nature of remote-sensing images leads to many semantic confusion zones in the semantic space, which g…

Cross-Modal RetrievalRetrieval