Learning Sentinel-2 reflectance dynamics for data-driven assimilation and forecasting
Over the last few years, massive amounts of satellite multispectral and hyperspectral images covering the Earth's surface have been made publicly available for scientific purpose, for example through the European Copernicus project. Simultaneously, the development of self-supervised learning (SSL) methods has sparked great interest in the remote sensing community, enabling to learn latent representations from unlabeled data to help treating downstream tasks for which there is few annotated examples, such as interpolation, forecasting or unmixing. Following this line, we train a deep learning model inspired from the Koopman operator theory to model long-term reflectance dynamics in an unsupervised way. We show that this trained model, being differentiable, can be used as a prior for data assimilation in a straightforward way. Our datasets, which are composed of Sentinel-2 multispectral image time series, are publicly released with several levels of treatment.
Code (1)
Tasks
Self-Supervised LearningTime SeriesSimilar Papers 제목 키워드 기반
Super-resolving multiresolution images with band-independant geometry of multispectral pixels
A new resolution enhancement method is presented for multispectral and multi-resolution images, such as these provided by the Sentinel-2 satellites. Starting from the highest resolution bands, band-dependent information …
Assimilating Soil Moisture Retrieved from Sentinel-1 and Sentinel-2 Data into WOFOST Model to Improve Winter Wheat Yield Estimation
Crop yield estimation at a regional scale over a long period of time is of great significance to food security. In past decades, the integration of remote sensing observations and crop growth models has been recognized a…
HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates
Recent deep learning methods for Landsat and Sentinel-2 reflectance time series reconstruction remain limited by restricted spectral coverage, limited geographic scalability, or patch-based designs with short temporal co…
Image ReconstructionValidation and Improvement of Data Assimilation for Flood Hydrodynamic Modelling Using SAR Imagery Data
Relevant comprehension of flood hazards has emerged as a crucial necessity, especially as the severity and the occurrence of flood events intensify with climate changes. Flood simulation and forecast capability have been…
FrictionLatent assimilation with implicit neural representations for unknown dynamics
Data assimilation is crucial in a wide range of applications, but it often faces challenges such as high computational costs due to data dimensionality and incomplete understanding of underlying mechanisms. To address th…