Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series
New remote sensing sensors now acquire high spatial and spectral Satellite Image Time Series (SITS) of the world. These series of images are a key component of classification systems that aim at obtaining up-to-date and accurate land cover maps of the Earth's surfaces. More specifically, the combination of the temporal, spectral and spatial resolutions of new SITS makes possible to monitor vegetation dynamics. Although traditional classification algorithms, such as Random Forest (RF), have been successfully applied for SITS classification, these algorithms do not make the most of the temporal domain. Conversely, some approaches that take into account the temporal dimension have recently been tested, especially Recurrent Neural Networks (RNNs). This paper proposes an exhaustive study of another deep learning approaches, namely Temporal Convolutional Neural Networks (TempCNNs) where convolutions are applied in the temporal dimension. The goal is to quantitatively and qualitatively evaluate the contribution of TempCNNs for SITS classification. This paper proposes a set of experiments performed on one million time series extracted from 46 Formosat-2 images. The experimental results show that TempCNNs are more accurate than RF and RNNs, that are the current state of the art for SITS classification. We also highlight some differences with results obtained in computer vision, e.g. about pooling layers. Moreover, we provide some general guidelines on the network architecture, common regularization mechanisms, and hyper-parameter values such as batch size. Finally, we assess the visual quality of the land cover maps produced by TempCNNs.
Code (1)
Tasks
ClassificationGeneral ClassificationImage ClassificationTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of ag…
General ClassificationTime SeriesTime Series AnalysisTime Series ClassificationRapidAI4EO: Mono- and Multi-temporal Deep Learning models for Updating the CORINE Land Cover Product
In the remote sensing community, Land Use Land Cover (LULC) classification with satellite imagery is a main focus of current research activities. Accurate and appropriate LULC classification, however, continues to be a c…
Change DetectionClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2Multi-Modal Vision Transformers for Crop Mapping from Satellite Image Time Series
Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS). Existing state-of-the-art architectures use s…
Time SeriesDeep Neural Networks for automatic extraction of features in time series satellite images
Many earth observation programs such as Landsat, Sentinel, SPOT, and Pleiades produce huge volume of medium to high resolution multi-spectral images every day that can be organized in time series. In this work, we exploi…
Earth ObservationLand Cover ClassificationTime SeriesTime Series AnalysisSITSMamba for Crop Classification based on Satellite Image Time Series
Satellite image time series (SITS) data provides continuous observations over time, allowing for the tracking of vegetation changes and growth patterns throughout the seasons and years. Numerous deep learning (DL) approa…
ClassificationCrop ClassificationMambaTime Series