Building-Guided Pseudo-Label Learning for Cross-Modal Building Damage Mapping

2025-05-08 · Jiepan Li, He Huang, Yu Sheng, Yujun Guo, wei he

Accurate building damage assessment using bi-temporal multi-modal remote sensing images is essential for effective disaster response and recovery planning. This study proposes a novel Building-Guided Pseudo-Label Learning Framework to address the challenges of mapping building damage from pre-disaster optical and post-disaster SAR images. First, we train a series of building extraction models using pre-disaster optical images and building labels. To enhance building segmentation, we employ multi-model fusion and test-time augmentation strategies to generate pseudo-probabilities, followed by a low-uncertainty pseudo-label training method for further refinement. Next, a change detection model is trained on bi-temporal cross-modal images and damaged building labels. To improve damage classification accuracy, we introduce a building-guided low-uncertainty pseudo-label refinement strategy, which leverages building priors from the previous step to guide pseudo-label generation for damaged buildings, reducing uncertainty and enhancing reliability. Experimental results on the 2025 IEEE GRSS Data Fusion Contest dataset demonstrate the effectiveness of our approach, which achieved the highest mIoU score (54.28%) and secured first place in the competition.

📄 PDF Abstract BibTeX arXiv:2505.04941

Code (1)

Henryjiepanli/Building-Guided-Pseudo-Label-Learning-for-Cross-Modal-Building-Damage-Mapping 공식 구현

Tasks

Building Damage Assessment Change DetectionDisaster ResponsePseudo Label

SAM-guided Pseudo Label Enhancement for Multi-modal 3D Semantic Segmentation

2025-02-02 · Mingyu Yang, Jitong Lu, Hun-Seok Kim

Multi-modal 3D semantic segmentation is vital for applications such as autonomous driving and virtual reality (VR). To effectively deploy these models in real-world scenarios, it is essential to employ cross-domain adapt…

3D Semantic Segmentation Autonomous Driving Domain Adaptation Pseudo Label+1

STiL: Semi-supervised Tabular-Image Learning for Comprehensive Task-Relevant Information Exploration in Multimodal Classification

2025-03-08 · CVPR 2025 1 · Siyi Du, Xinzhe Luo, Declan P. O'Regan, Chen Qin

Multimodal image-tabular learning is gaining attention, yet it faces challenges due to limited labeled data. While earlier work has applied self-supervised learning (SSL) to unlabeled data, its task-agnostic nature often…

Disentanglement Pseudo Label Self-Supervised Learning

DuSSS: Dual Semantic Similarity-Supervised Vision-Language Model for Semi-Supervised Medical Image Segmentation

2024-12-17 · Qingtao Pan, Wenhao Qiao, Jingjiao Lou, Bing Ji 외

Semi-supervised medical image segmentation (SSMIS) uses consistency learning to regularize model training, which alleviates the burden of pixel-wise manual annotations. However, it often suffers from error supervision fr…

Contrastive Learning Image Segmentation Language Modeling Language Modelling+6

Fine-tuning Pre-trained Vision-Language Models in a Human-Annotation-Free Manner

2026-02-04 · Qian-Wei Wang, Guanghao Meng, Ren Cai, Yaguang Song 외 arxiv

Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods re…

parameter-efficient fine-tuning Zero-shot Generalization Contrastive Learning

Multi-level Cross-modal Alignment for Image Clustering

2024-01-22 · Liping Qiu, Qin Zhang, Xiaojun Chen, Shaotian Cai

Recently, the cross-modal pretraining model has been employed to produce meaningful pseudo-labels to supervise the training of an image clustering model. However, numerous erroneous alignments in a cross-modal pre-traini…

Clustering cross-modal alignment Image Clustering