paper-with-me

홈 › Papers

Multi-step feature fusion for natural disaster damage assessment on satellite images

2024-10-29 · Mateusz Żarski, Jarosław Adam Miszczak

Quick and accurate assessment of the damage state of buildings after natural disasters is crucial for undertaking properly targeted rescue and subsequent recovery operations, which can have a major impact on the safety of victims and the cost of disaster recovery. The quality of such a process can be significantly improved by harnessing the potential of machine learning methods in computer vision. This paper presents a novel damage assessment method using an original multi-step feature fusion network for the classification of the damage state of buildings based on pre- and post-disaster large-scale satellite images. We introduce a novel convolutional neural network (CNN) module that performs feature fusion at multiple network levels between pre- and post-disaster images in the horizontal and vertical directions of CNN network. An additional network element - Fuse Module - was proposed to adapt any CNN model to analyze image pairs in the issue of pair classification. We use, open, large-scale datasets (IDA-BD and xView2) to verify, that the proposed method is suitable to improve on existing state-of-the-art architectures. We report over a 3 percentage point increase in the accuracy of the Vision Transformer model.

📄 PDF Abstract BibTeX arXiv:2410.21901

Code (1)

matzar01/eq_vis 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

SiamixFormer: a fully-transformer Siamese network with temporal Fusion for accurate building detection and change detection in bi-temporal remote sensing images

2022-08-01 · Amir mohammadian, Foad Ghaderi

Building detection and change detection using remote sensing images can help urban and rescue planning. Moreover, they can be used for building damage assessment after natural disasters. Currently, most of the existing m…

2D Semantic SegmentationBuilding change detection for remote sensing imagesBuilding Damage AssessmentChange Detection+3

Exploring Multimodal Features and Fusion Strategies for Analyzing Disaster Tweets

2022-10-01 · COLING (WNUT) 2022 10 · Raj Pranesh

Social media platforms, such as Twitter, often provide firsthand news during the outbreak of a crisis. It is extremely essential to process these facts quickly to plan the response efforts for minimal loss. Therefore, in…

Transfer Learning

Cross-directional Feature Fusion Network for Building Damage Assessment from Satellite Imagery

2020-10-27 · Yu Shen, Sijie Zhu, Taojiannan Yang, Chen Chen

Fast and effective responses are required when a natural disaster (e.g., earthquake, hurricane, etc.) strikes. Building damage assessment from satellite imagery is critical before an effective response is conducted. High…

2D Semantic SegmentationBuilding Damage AssessmentData Augmentation

Disaster Question Answering with LoRA Efficiency and Accurate End Position

2026-01-28 · Takato Yasuno arxiv

Natural disasters such as earthquakes, torrential rainfall, floods, and volcanic eruptions occur with extremely low frequency and affect limited geographic areas. When individuals face disaster situations, they often exp…

Continual LearningQuestion Answering

Exploring Multimodal Features and Fusion Strategies for Analyzing Disaster Tweets

2020-11-06 · Raj Ratn Pranesh, Ambesh Shekhar, Anish Kumar

Social media platforms such as Twitter often provide firsthand news during the outbreak of a crisis. It is extremely essential to process these facts quickly to plan the response efforts for minimal loss. Processing th…

Multimodal Deep LearningTransfer Learning