paper-with-me

홈 › Papers

A Spatially Masked Adaptive Gated Network for multimodal post-flood water extent mapping using SAR and incomplete multispectral data

2025-12-31 · Hyunho Lee, Wenwen Li arxiv

Mapping water extent during a flood event is essential for effective disaster management throughout all phases: mitigation, preparedness, response, and recovery. In particular, during the response stage, when timely and accurate information is important, Synthetic Aperture Radar (SAR) data are primarily employed to produce water extent maps. Recently, leveraging the complementary characteristics of SAR and MSI data through a multimodal approach has emerged as a promising strategy for advancing water extent mapping using deep learning models. This approach is particularly beneficial when timely post-flood observations, acquired during or shortly after the flood peak, are limited, as it enables the use of all available imagery for more accurate post-flood water extent mapping. However, the adaptive integration of partially available MSI data into the SAR-based post-flood water extent mapping process remains underexplored. To bridge this research gap, we propose the Spatially Masked Adaptive Gated Network (SMAGNet), a multimodal deep learning model that utilizes SAR data as the primary input for post-flood water extent mapping and integrates complementary MSI data through feature fusion. In experiments on the C2S-MS Floods dataset, SMAGNet consistently outperformed other multimodal deep learning models in prediction performance across varying levels of MSI data availability. Furthermore, we found that even when MSI data were completely missing, the performance of SMAGNet remained statistically comparable to that of a U-Net model trained solely on SAR data. These findings indicate that SMAGNet enhances the model robustness to missing data as well as the applicability of multimodal deep learning in real-world flood management scenarios.

📄 PDF Abstract BibTeX arXiv:2601.00123

Code (0)

등록된 구현이 없습니다.

Tasks

Multimodal Deep Learning

Similar Papers 제목 키워드 기반

CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders

2023-11-01 · NeurIPS 2023 11 · Anthony Fuller, Koreen Millard, James R. Green

A vital and rapidly growing application, remote sensing offers vast yet sparsely labeled, spatially aligned multimodal data; this makes self-supervised learning algorithms invaluable. We present CROMA: a framework that c…

AvgContrastive LearningDecoderSelf-Supervised Learning

Robust Multimodal Learning via Entropy-Gated Contrastive Fusion

2025-05-21 · Leon Chlon, Maggie Chlon, MarcAntonio M. Awada

Real-world multimodal systems routinely face missing-input scenarios, and in reality, robots lose audio in a factory or a clinical record omits lab tests at inference time. Standard fusion layers either preserve robustne…

Towards Exploiting Sticker for Multimodal Sentiment Analysis in Social Media: A New Dataset and Baseline

2022-10-01 · COLING 2022 10 · Feng Ge, Weizhao Li, Haopeng Ren, Yi Cai

Sentiment analysis in social media is challenging since posts are short of context. As a popular way to express emotion on social media, stickers related to these posts can supplement missing sentiments and help identify…

Multimodal Sentiment AnalysisSentiment Analysis

GaussFusion: Towards Multimodal 3D Gaussian Pretraining

2026-07-07 · Zhixuan You, Jihua Zhu, Yiding Sun, Zihao Guo 외 arxiv

3D Gaussian Splatting provides an explicit representation that jointly models geometry and appearance, serving as a scalable foundation for 3D representation learning. Existing pre-training methods for Gaussian represent…

Representation Learning

Weakly-Supervised Learning of Visual Relations in Multimodal Pretraining

2023-05-23 · Emanuele Bugliarello, Aida Nematzadeh, Lisa Anne Hendricks

Recent work in vision-and-language pretraining has investigated supervised signals from object detection data to learn better, fine-grained multimodal representations. In this work, we take a step further and explore how…

object-detectionObject DetectionRelationRelation Prediction+1