SAMSelect: A Spectral Index Search for Marine Debris Visualization using Segment Anything
This work proposes SAMSelect, an algorithm to obtain a salient three-channel visualization for multispectral images. We develop SAMSelect and show its use for marine scientists visually interpreting floating marine debris in Sentinel-2 imagery. These debris are notoriously difficult to visualize due to their compositional heterogeneity in medium-resolution imagery. Out of these difficulties, a visual interpretation of imagery showing marine debris remains a common practice by domain experts, who select bands and spectral indices on a case-by-case basis informed by common practices and heuristics. SAMSelect selects the band or index combination that achieves the best classification accuracy on a small annotated dataset through the Segment Anything Model. Its central assumption is that the three-channel visualization achieves the most accurate segmentation results also provide good visual information for photo-interpretation. We evaluate SAMSelect in three Sentinel-2 scenes containing generic marine debris in Accra, Ghana, and Durban, South Africa, and deployed plastic targets from the Plastic Litter Project. This reveals the potential of new previously unused band combinations (e.g., a normalized difference index of B8, B2), which demonstrate improved performance compared to literature-based indices. We describe the algorithm in this paper and provide an open-source code repository that will be helpful for domain scientists doing visual photo interpretation, especially in the marine field.
Code (1)
Similar Papers 제목 키워드 기반
MARIDA: A benchmark for Marine Debris detection from Sentinel-2 remote sensing data
Currently, a significant amount of research is focused on detecting Marine Debris and assessing its spectral behaviour via remote sensing, ultimately aiming at new operational monitoring solutions. Here, we introduce a M…
Image SegmentationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSemantic Segmentation+3Assessment of Spectral based Solutions for the Detection of Floating Marine Debris
Typically, the detection of marine debris relies on in-situ campaigns that are characterized by huge human effort and limited spatial coverage. Following the need of a rapid solution for the detection of floating plastic…
Increasing the Sentinel-2 potential for marine plastic litter monitoring through image fusion techniques
Sentinel-2 (S2) images have been used in several projects to detect large accumulations of marine litter and plastic targets. Their limited spatial resolution though hinders the detection of relatively small floating acc…
Image Super-ResolutionDetection of marine floating plastic using Sentinel-2 imagery and machine learning models
The increasing level of marine plastic pollution poses severe threats to the marine ecosystem and biodiversity. The present study attempted to explore the full functionality of open Sentinel satellite data and ML models …
BIG-bench Machine LearningSpectral Analysis of Marine Debris in Simulated and Observed Sentinel-2/MSI Images using Unsupervised Classification
Marine litter poses significant threats to marine and coastal environments, with its impacts ever-growing. Remote sensing provides an advantageous supplement to traditional mitigation techniques, such as local cleaning o…