Weakly-Supervised Cloud Detection with Fixed-Point GANs
The detection of clouds in satellite images is an essential preprocessing task for big data in remote sensing. Convolutional neural networks (CNNs) have greatly advanced the state-of-the-art in the detection of clouds in satellite images, but existing CNN-based methods are costly as they require large amounts of training images with expensive pixel-level cloud labels. To alleviate this cost, we propose Fixed-Point GAN for Cloud Detection (FCD), a weakly-supervised approach. Training with only image-level labels, we learn fixed-point translation between clear and cloudy images, so only clouds are affected during translation. Doing so enables our approach to predict pixel-level cloud labels by translating satellite images to clear ones and setting a threshold to the difference between the two images. Moreover, we propose FCD+, where we exploit the label-noise robustness of CNNs to refine the prediction of FCD, leading to further improvements. We demonstrate the effectiveness of our approach on the Landsat-8 Biome cloud detection dataset, where we obtain performance close to existing fully-supervised methods that train with expensive pixel-level labels. By fine-tuning our FCD+ with just 1% of the available pixel-level labels, we match the performance of fully-supervised methods.
Code (1)
Tasks
Cloud DetectionTranslationSimilar Papers 제목 키워드 기반
Weakly Supervised 3D Object Detection from Point Clouds
A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bo…
3D Object DetectionKnowledge DistillationObjectobject-detection+3WSDesc: Weakly Supervised 3D Local Descriptor Learning for Point Cloud Registration
In this work, we present a novel method called WSDesc to learn 3D local descriptors in a weakly supervised manner for robust point cloud registration. Our work builds upon recent 3D CNN-based descriptor extractors, which…
Metric LearningPoint Cloud Registration3D Spatial Recognition without Spatially Labeled 3D
We introduce WyPR, a Weakly-supervised framework for Point cloud Recognition, requiring only scene-level class tags as supervision. WyPR jointly addresses three core 3D recognition tasks: point-level semantic segmentatio…
3D Object DetectionMultiple Instance LearningObjectobject-detection+4Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud
Existing methods for large-scale point cloud semantic segmentation require expensive, tedious and error-prone manual point-wise annotations. Intuitively, weakly supervised training is a direct solution to reduce the cost…
ColorizationPseudo LabelSelf-Supervised LearningSemantic Segmentation+2Weakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistency
Monocular 3D object detection has become a mainstream approach in automatic driving for its easy application. A prominent advantage is that it does not need LiDAR point clouds during the inference. However, most current …
3D Object DetectionMonocular 3D Object Detectionobject-detectionObject Detection