paper-with-me

홈 › Papers

Improving Satellite Imagery Masking using Multi-task and Transfer Learning

2024-12-11 · Rangel Daroya, Luisa Vieira Lucchese, Travis Simmons, Punwath Prum, Tamlin Pavelsky, John Gardner, Colin J. Gleason, Subhransu Maji

Many remote sensing applications employ masking of pixels in satellite imagery for subsequent measurements. For example, estimating water quality variables, such as Suspended Sediment Concentration (SSC) requires isolating pixels depicting water bodies unaffected by clouds, their shadows, terrain shadows, and snow and ice formation. A significant bottleneck is the reliance on a variety of data products (e.g., satellite imagery, elevation maps), and a lack of precision in individual steps affecting estimation accuracy. We propose to improve both the accuracy and computational efficiency of masking by developing a system that predicts all required masks from Harmonized Landsat and Sentinel (HLS) imagery. Our model employs multi-tasking to share computation and enable higher accuracy across tasks. We experiment with recent advances in deep network architectures and show that masking models can benefit from these, especially when combined with pre-training on large satellite imagery datasets. We present a collection of models offering different speed/accuracy trade-offs for masking. MobileNet variants are the fastest, and perform competitively with larger architectures. Transformer-based architectures are the slowest, but benefit the most from pre-training on large satellite imagery datasets. Our models provide a 9% F1 score improvement compared to previous work on water pixel identification. When integrated with an SSC estimation system, our models result in a 30x speedup while reducing estimation error by 2.64 mg/L, allowing for global-scale analysis. We also evaluate our model on a recently proposed cloud and cloud shadow estimation benchmark, where we outperform the current state-of-the-art model by at least 6% in F1 score.

📄 PDF Abstract BibTeX arXiv:2412.08545

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyTransfer Learning

Similar Papers 제목 키워드 기반

SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery

2022-07-17 · Yezhen Cong, Samar Khanna, Chenlin Meng, Patrick Liu 외

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabe…

Land Cover ClassificationSemantic SegmentationTransfer LearningUnsupervised Pre-training

Multi-Modal Building Inspection via Perceiver IO Fusion of Satellite and Street-Level Imagery

2026-05-25 · Niels Sombekke, Rob G. J. Wijnhoven, Martin R. Oswald arxiv

We present a multi-modal classification framework that fuses satellite and street-level imagery through a Perceiver IO architecture operating on spatial patch tokens from a shared DINOv2 backbone. The design naturally ha…

Multi-modal Classification

Segmenting across places: The need for fair transfer learning with satellite imagery

2022-04-09 · Miao Zhang, Harvineet Singh, Lazarus Chok, Rumi Chunara

The increasing availability of high-resolution satellite imagery has enabled the use of machine learning to support land-cover measurement and inform policy-making. However, labelling satellite images is expensive and is…

Domain AdaptationFairnessImage SegmentationSegmentation+3

Automatic Detection of Dark Ship-to-Ship Transfers using Deep Learning and Satellite Imagery

2024-04-11 · Ollie Ballinger

Despite extensive research into ship detection via remote sensing, no studies identify ship-to-ship transfers in satellite imagery. Given the importance of transshipment in illicit shipping practices, this is a significa…

H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain Adaptation and Label Refinement

2020-10-11 · Peri Akiva, Matthew Purri, Kristin Dana, Beth Tellman 외

Accurate flood detection in near real time via high resolution, high latency satellite imagery is essential to prevent loss of lives by providing quick and actionable information. Instruments and sensors useful for flood…

Domain AdaptationSegmentationSemantic Segmentation