paper-with-me

홈 › Papers

Learning Efficient Unsupervised Satellite Image-based Building Damage Detection

2023-12-04 · Yiyun Zhang, Zijian Wang, Yadan Luo, Xin Yu, Zi Huang

Existing Building Damage Detection (BDD) methods always require labour-intensive pixel-level annotations of buildings and their conditions, hence largely limiting their applications. In this paper, we investigate a challenging yet practical scenario of BDD, Unsupervised Building Damage Detection (U-BDD), where only unlabelled pre- and post-disaster satellite image pairs are provided. As a pilot study, we have first proposed an advanced U-BDD baseline that leverages pre-trained vision-language foundation models (i.e., Grounding DINO, SAM and CLIP) to address the U-BDD task. However, the apparent domain gap between satellite and generic images causes low confidence in the foundation models used to identify buildings and their damages. In response, we further present a novel self-supervised framework, U-BDD++, which improves upon the U-BDD baseline by addressing domain-specific issues associated with satellite imagery. Furthermore, the new Building Proposal Generation (BPG) module and the CLIP-enabled noisy Building Proposal Selection (CLIP-BPS) module in U-BDD++ ensure high-quality self-training. Extensive experiments on the widely used building damage assessment benchmark demonstrate the effectiveness of the proposed method for unsupervised building damage detection. The presented annotation-free and foundation model-based paradigm ensures an efficient learning phase. This study opens a new direction for real-world BDD and sets a strong baseline for future research.

📄 PDF Abstract BibTeX arXiv:2312.01576

Code (1)

fzmi/ubdd 공식 구현 pytorch

Tasks

Building Damage AssessmentDamaged Building DetectionDisaster ResponseExtracting Buildings In Remote Sensing ImagesSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
SAM 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

QuickQuakeBuildings: Post-earthquake SAR-Optical Dataset for Quick Damaged-building Detection

2023-12-11 · Yao Sun, Yi Wang, Michael Eineder

Quick and automated earthquake-damaged building detection from post-event satellite imagery is crucial, yet it is challenging due to the scarcity of training data required to develop robust algorithms. This letter presen…

Anomaly DetectionDamaged Building Detectionimage-classificationImage Classification

Building Damage Detection in Satellite Imagery Using Convolutional Neural Networks

2019-10-14 · Joseph Z. Xu, Wenhan Lu, Zebo Li, Pranav Khaitan 외

In all types of disasters, from earthquakes to armed conflicts, aid workers need accurate and timely data such as damage to buildings and population displacement to mount an effective response. Remote sensing provides th…

BIG-bench Machine Learning

xBD: A Dataset for Assessing Building Damage from Satellite Imagery

2019-11-21 · Ritwik Gupta, Richard Hosfelt, Sandra Sajeev, Nirav Patel 외

We present xBD, a new, large-scale dataset for the advancement of change detection and building damage assessment for humanitarian assistance and disaster recovery research. Natural disaster response requires an accurate…

2D Semantic SegmentationBuilding Damage AssessmentChange DetectionDisaster Response+1

Large-scale Building Damage Assessment using a Novel Hierarchical Transformer Architecture on Satellite Images

2022-08-03 · Navjot Kaur, Cheng-Chun Lee, Ali Mostafavi, Ali Mahdavi-Amiri

This paper presents \dahitra, a novel deep-learning model with hierarchical transformers to classify building damages based on satellite images in the aftermath of natural disasters. Satellite imagery provides real-time …

Building Damage AssessmentChange DetectionDecision MakingDomain Adaptation

Building Disaster Damage Assessment in Satellite Imagery with Multi-Temporal Fusion

2020-04-12 · Ethan Weber, Hassan Kané

Automatic change detection and disaster damage assessment are currently procedures requiring a huge amount of labor and manual work by satellite imagery analysts. In the occurrences of natural disasters, timely change de…

2D Semantic SegmentationBuilding Damage AssessmentChange Detection