Understanding the Role of Weather Data for Earth Surface Forecasting using a ConvLSTM-based Model
Climate change is perhaps the biggest single threat to humankind and the environment, as it severely impacts our terrestrial surface, home to most of the living species. Inspired by video prediction and exploiting the availability of Copernicus Sentinel-2 images, recent studies have attempted to forecast the land surface evolution as a function of past land surface evolution, elevation, and weather. Further extending this paradigm, we propose a model based on convolutional long short-term memory (ConvLSTM) that is computationally efficient (lightweight), however obtains superior results to the previous baselines. By introducing a ConvLSTM-based architecture to this problem, we can not only ingest the heterogeneous data sources (Sentinel2 time-series, weather data, and a Digital Elevation Model (DEM)) but also explicitly condition the future predictions on the weather. Our experiments confirm the importance of weather parameters in understanding the land cover dynamics and show that weather maps are significantly more important than the DEM in this task. Furthermore, we perform generative simulations to investigate how varying a single weather parameter can alter the evolution of the land surface. All studies are performed using the EarthNet2021 dataset. The code, additional materials and results can be found at https://github.com/dcodrut/weather2land.
Code (1)
Tasks
Earth Surface ForecastingTime SeriesTime Series AnalysisVideo PredictionSimilar Papers 제목 키워드 기반
EarthNet2021: A novel large-scale dataset and challenge for forecasting localized climate impacts
Climate change is global, yet its concrete impacts can strongly vary between different locations in the same region. Seasonal weather forecasts currently operate at the mesoscale (> 1 km). For more targeted mitigation an…
Crop Yield PredictionEarth ObservationEarth Surface ForecastingManagement+1EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction task
Satellite images are snapshots of the Earth surface. We propose to forecast them. We frame Earth surface forecasting as the task of predicting satellite imagery conditioned on future weather. EarthNet2021 is a large data…
Crop Yield PredictionEarth Surface ForecastingTime Series ForecastingVideo Forensics+1Learning Coupled Earth System Dynamics with GraphDOP
Interactions between different components of the Earth System (e.g. ocean, atmosphere, land and cryosphere) are a crucial driver of global weather patterns. Modern Numerical Weather Prediction (NWP) systems typically run…
Weather ForecastingPhysics-Assisted and Topology-Informed Deep Learning for Weather Prediction
Although deep learning models have demonstrated remarkable potential in weather prediction, most of them overlook either the \textbf{physics} of the underlying weather evolution or the \textbf{topology} of the Earth's su…
Deep LearningGraph Neural NetworkPredictionDeep Learning-based Damage Mapping with InSAR Coherence Time Series
Satellite remote sensing is playing an increasing role in the rapid mapping of damage after natural disasters. In particular, synthetic aperture radar (SAR) can image the Earth's surface and map damage in all weather con…
Deep LearningTime SeriesTime Series Analysis