Multi-step feature fusion for natural disaster damage assessment on satellite images
Quick and accurate assessment of the damage state of buildings after natural disasters is crucial for undertaking properly targeted rescue and subsequent recovery operations, which can have a major impact on the safety of victims and the cost of disaster recovery. The quality of such a process can be significantly improved by harnessing the potential of machine learning methods in computer vision. This paper presents a novel damage assessment method using an original multi-step feature fusion network for the classification of the damage state of buildings based on pre- and post-disaster large-scale satellite images. We introduce a novel convolutional neural network (CNN) module that performs feature fusion at multiple network levels between pre- and post-disaster images in the horizontal and vertical directions of CNN network. An additional network element - Fuse Module - was proposed to adapt any CNN model to analyze image pairs in the issue of pair classification. We use, open, large-scale datasets (IDA-BD and xView2) to verify, that the proposed method is suitable to improve on existing state-of-the-art architectures. We report over a 3 percentage point increase in the accuracy of the Vision Transformer model.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SiamixFormer: a fully-transformer Siamese network with temporal Fusion for accurate building detection and change detection in bi-temporal remote sensing images
Building detection and change detection using remote sensing images can help urban and rescue planning. Moreover, they can be used for building damage assessment after natural disasters. Currently, most of the existing m…
2D Semantic SegmentationBuilding change detection for remote sensing imagesBuilding Damage AssessmentChange Detection+3Exploring Multimodal Features and Fusion Strategies for Analyzing Disaster Tweets
Social media platforms, such as Twitter, often provide firsthand news during the outbreak of a crisis. It is extremely essential to process these facts quickly to plan the response efforts for minimal loss. Therefore, in…
Transfer LearningCross-directional Feature Fusion Network for Building Damage Assessment from Satellite Imagery
Fast and effective responses are required when a natural disaster (e.g., earthquake, hurricane, etc.) strikes. Building damage assessment from satellite imagery is critical before an effective response is conducted. High…
2D Semantic SegmentationBuilding Damage AssessmentData AugmentationDisaster Question Answering with LoRA Efficiency and Accurate End Position
Natural disasters such as earthquakes, torrential rainfall, floods, and volcanic eruptions occur with extremely low frequency and affect limited geographic areas. When individuals face disaster situations, they often exp…
Continual LearningQuestion AnsweringExploring Multimodal Features and Fusion Strategies for Analyzing Disaster Tweets
Social media platforms such as Twitter often provide firsthand news during the outbreak of a crisis. It is extremely essential to process these facts quickly to plan the response efforts for minimal loss. Processing th…
Multimodal Deep LearningTransfer Learning