Towards Automatic Transformer-based Cloud Classification and Segmentation
Clouds have been demonstrated to have a huge impact on the energy balance, temperature, and weather of the Earth. Classification and segmentation of clouds and coverage factors are crucial for climate modeling, meteorological studies, the solar energy industry, and satellite communication. For example, clouds have a tremendous impact on short-term predictions or 'nowcasts' of solar irradiance and can be used to optimize solar power plants and effectively exploit solar energy. However even today, cloud observation requires the intervention of highly-trained professionals to document their findings, which introduces bias. To overcome these issues and contribute to climate change technology, we propose the first two transformer-based models applied to cloud data tasks to the best of our knowledge. We use the CCSD Cloud classification dataset and achieve 90.06% accuracy, outperforming all other methods. To demonstrate the robustness of transformers in this domain, we perform Cloud segmentation on the SWIMSWG dataset and achieve 83.2% IoU, outperforming other methods. With this, we signal a potential shift away from pure CNN networks.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationSimilar Papers 제목 키워드 기반
Paris-Lille-3D: a large and high-quality ground truth urban point cloud dataset for automatic segmentation and classification
This paper introduces a new Urban Point Cloud Dataset for Automatic Segmentation and Classification acquired by Mobile Laser Scanning (MLS). We describe how the dataset is obtained from acquisition to post-processing and…
ClassificationGeneral ClassificationLIDAR Semantic SegmentationSegmentationPoint Transformer
Self-attention networks have revolutionized natural language processing and are making impressive strides in image analysis tasks such as image classification and object detection. Inspired by this success, we investigat…
3D Part Segmentation3D Point Cloud Classification3D Semantic SegmentationGeneral Classification+8PointCAT: Cross-Attention Transformer for point cloud
Transformer-based models have significantly advanced natural language processing and computer vision in recent years. However, due to the irregular and disordered structure of point cloud data, transformer-based models f…
SegmentationSemantic SegmentationIterative Transformer Network for 3D Point Cloud
3D point cloud is an efficient and flexible representation of 3D structures. Recently, neural networks operating on point clouds have shown superior performance on 3D understanding tasks such as shape classification and …
General ClassificationObjectSegmentation3DGTN: 3D Dual-Attention GLocal Transformer Network for Point Cloud Classification and Segmentation
Although the application of Transformers in 3D point cloud processing has achieved significant progress and success, it is still challenging for existing 3D Transformer methods to efficiently and accurately learn both va…
ClassificationDecoderPoint Cloud ClassificationSegmentation