Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of agricultural parcels is an issue of major political and economic importance. In this regard, hybrid convolutional-recurrent neural architectures have shown promising results for the automated classification of satellite image time series.We propose an alternative approach in which the convolutional layers are advantageously replaced with encoders operating on unordered sets of pixels to exploit the typically coarse resolution of publicly available satellite images. We also propose to extract temporal features using a bespoke neural architecture based on self-attention instead of recurrent networks. We demonstrate experimentally that our method not only outperforms previous state-of-the-art approaches in terms of precision, but also significantly decreases processing time and memory requirements. Lastly, we release a large open-access annotated dataset as a benchmark for future work on satellite image time series.
Code (2)
Tasks
General ClassificationTime SeriesTime Series AnalysisTime Series ClassificationSimilar Papers 제목 키워드 기반
Pixel-Wise Multimodal Contrastive Learning for Remote Sensing Images
Satellites continuously generate massive volumes of data, particularly for Earth observation, including satellite image time series (SITS). However, most deep learning models are designed to process either entire images …
Contrastive LearningPixel-wise Agricultural Image Time Series Classification: Comparisons and a Deformable Prototype-based Approach
Improvements in Earth observation by satellites allow for imagery of ever higher temporal and spatial resolution. Leveraging this data for agricultural monitoring is key for addressing environmental and economic challeng…
Earth ObservationSegmentationTime SeriesTime Series ClassificationSeeing Through the Clouds: Cloud Gap Imputation with Prithvi Foundation Model
Filling cloudy pixels in multispectral satellite imagery is essential for accurate data analysis and downstream applications, especially for tasks which require time series data. To address this issue, we compare the per…
Generative Adversarial NetworkImputationTime SeriesMulti-Modal Temporal Attention Models for Crop Mapping from Satellite Time Series
Optical and radar satellite time series are synergetic: optical images contain rich spectral information, while C-band radar captures useful geometrical information and is immune to cloud cover. Motivated by the recent s…
Panoptic SegmentationSemantic SegmentationTime SeriesTime Series AnalysisLand Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks
Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information i…
ClassificationEarth ObservationGeneral ClassificationLand Cover Classification+4