Learning Efficient Unsupervised Satellite Image-based Building Damage Detection
Existing Building Damage Detection (BDD) methods always require labour-intensive pixel-level annotations of buildings and their conditions, hence largely limiting their applications. In this paper, we investigate a challenging yet practical scenario of BDD, Unsupervised Building Damage Detection (U-BDD), where only unlabelled pre- and post-disaster satellite image pairs are provided. As a pilot study, we have first proposed an advanced U-BDD baseline that leverages pre-trained vision-language foundation models (i.e., Grounding DINO, SAM and CLIP) to address the U-BDD task. However, the apparent domain gap between satellite and generic images causes low confidence in the foundation models used to identify buildings and their damages. In response, we further present a novel self-supervised framework, U-BDD++, which improves upon the U-BDD baseline by addressing domain-specific issues associated with satellite imagery. Furthermore, the new Building Proposal Generation (BPG) module and the CLIP-enabled noisy Building Proposal Selection (CLIP-BPS) module in U-BDD++ ensure high-quality self-training. Extensive experiments on the widely used building damage assessment benchmark demonstrate the effectiveness of the proposed method for unsupervised building damage detection. The presented annotation-free and foundation model-based paradigm ensures an efficient learning phase. This study opens a new direction for real-world BDD and sets a strong baseline for future research.
Code (1)
Tasks
Building Damage AssessmentDamaged Building DetectionDisaster ResponseExtracting Buildings In Remote Sensing ImagesSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
QuickQuakeBuildings: Post-earthquake SAR-Optical Dataset for Quick Damaged-building Detection
Quick and automated earthquake-damaged building detection from post-event satellite imagery is crucial, yet it is challenging due to the scarcity of training data required to develop robust algorithms. This letter presen…
Anomaly DetectionDamaged Building Detectionimage-classificationImage ClassificationBuilding Damage Detection in Satellite Imagery Using Convolutional Neural Networks
In all types of disasters, from earthquakes to armed conflicts, aid workers need accurate and timely data such as damage to buildings and population displacement to mount an effective response. Remote sensing provides th…
BIG-bench Machine LearningxBD: A Dataset for Assessing Building Damage from Satellite Imagery
We present xBD, a new, large-scale dataset for the advancement of change detection and building damage assessment for humanitarian assistance and disaster recovery research. Natural disaster response requires an accurate…
2D Semantic SegmentationBuilding Damage AssessmentChange DetectionDisaster Response+1Large-scale Building Damage Assessment using a Novel Hierarchical Transformer Architecture on Satellite Images
This paper presents \dahitra, a novel deep-learning model with hierarchical transformers to classify building damages based on satellite images in the aftermath of natural disasters. Satellite imagery provides real-time …
Building Damage AssessmentChange DetectionDecision MakingDomain AdaptationBuilding Disaster Damage Assessment in Satellite Imagery with Multi-Temporal Fusion
Automatic change detection and disaster damage assessment are currently procedures requiring a huge amount of labor and manual work by satellite imagery analysts. In the occurrences of natural disasters, timely change de…
2D Semantic SegmentationBuilding Damage AssessmentChange Detection