Multiresolution Fully Convolutional Networks to detect Clouds and Snow through Optical Satellite Images
Clouds and snow have similar spectral features in the visible and near-infrared (VNIR) range and are thus difficult to distinguish from each other in high resolution VNIR images. We address this issue by introducing a shortwave-infrared (SWIR) band where clouds are highly reflective, and snow is absorptive. As SWIR is typically of a lower resolution compared to VNIR, this study proposes a multiresolution fully convolutional neural network (FCN) that can effectively detect clouds and snow in VNIR images. We fuse the multiresolution bands within a deep FCN and perform semantic segmentation at the higher, VNIR resolution. Such a fusion-based classifier, trained in an end-to-end manner, achieved 94.31% overall accuracy and an F1 score of 97.67% for clouds on Resourcesat-2 data captured over the state of Uttarakhand, India. These scores were found to be 30% higher than a Random Forest classifier, and 10% higher than a standalone single-resolution FCN. Apart from being useful for cloud detection purposes, the study also highlights the potential of convolutional neural networks for multi-sensor fusion problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Cloud DetectionSemantic SegmentationSensor FusionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LiSnowNet: Real-time Snow Removal for LiDAR Point Cloud
LiDARs have been widely adopted to modern self-driving vehicles, providing 3D information of the scene and surrounding objects. However, adverser weather conditions still pose significant challenges to LiDARs since point…
Snow RemovalSnow Removal for LiDAR Point Clouds with Spatio-temporal Conditional Random Fields
LiDAR sensors have been extensively used in numerous applications, including autonomous driving, owing to their ability to generate high-quality 3D point clouds. However, the sensor can be greatly affected in adverse wea…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1LiDAR Snowfall Simulation for Robust 3D Object Detection
3D object detection is a central task for applications such as autonomous driving, in which the system needs to localize and classify surrounding traffic agents, even in the presence of adverse weather. In this paper, we…
3D Object DetectionAutonomous DrivingObjectobject-detection+3Learning to detect cloud and snow in remote sensing images from noisy labels
Detecting clouds and snow in remote sensing images is an essential preprocessing task for remote sensing imagery. Previous works draw inspiration from semantic segmentation models in computer vision, with most research f…
DiversitySemantic SegmentationSLiDE: Self-supervised LiDAR De-snowing through Reconstruction Difficulty
LiDAR is widely used to capture accurate 3D outdoor scene structures. However, LiDAR produces many undesirable noise points in snowy weather, which hamper analyzing meaningful 3D scene structures. Semantic segmentation w…
Self-Supervised LearningSemantic Segmentation