paper-with-me

Papers

Spatio-Temporal Transformers for Long-Term NDVI Forecasting

2026-02-02 · Ido Faran, Nathan S. Netanyahu, Maxim Shoshany arxiv

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental changes interact across different scales. This paper presents the Spatio-Temporal Transformer for Long Term Forecasting (STT-LTF ), an extended framework that advances beyond purely temporal analysis to integrate spatial context modeling with temporal sequence prediction. STT-LTF processes multi-scale spatial patches alongside temporal sequences (up to 20 years) through a unified transformer architecture, capturing both local neighborhood relationships and regional climate influences. The framework employs comprehensive self-supervised learning with spatial masking, temporal masking, and horizon sampling strategies, enabling robust model training from 40 years of unlabeled Landsat imagery. Unlike autoregressive approaches, STT-LTF directly predicts arbitrary future time points without error accumulation, incorporating spatial patch embeddings, cyclical temporal encoding, and geographic coordinates to learn complex dependencies across heterogeneous Mediterranean ecosystems. Experimental evaluation on Landsat data (1984-2024) demonstrates that STT-LTF achieves a Mean Absolute Error (MAE) of 0.0328 and R^2 of 0.8412 for next-year predictions, outperforming traditional statistical methods, CNN-based approaches, LSTM networks, and standard transformers. The framework's ability to handle irregular temporal sampling and variable prediction horizons makes it particularly suitable for analysis of heterogeneous landscapes experiencing rapid ecological transitions.

📄 PDF Abstract BibTeX arXiv:2602.01799

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningTemporal Sequences

Similar Papers 제목 키워드 기반

Long time-series NDVI reconstruction in cloud-prone regions via spatio-temporal tensor completion

2021-02-04 · Dong Chu, Huanfeng Shen, Xiaobin Guan, Jing M. Chen 외

The applications of Normalized Difference Vegetation Index (NDVI) time-series data are inevitably hampered by cloud-induced gaps and noise. Although numerous reconstruction methods have been developed, they have not effe…

Time SeriesTime Series Analysis

Cluster-Segregate-Perturb (CSP): A Model-agnostic Explainability Pipeline for Spatiotemporal Land Surface Forecasting Models

2024-08-12 · Tushar Verma, Sudipan Saha

Satellite images have become increasingly valuable for modelling regional climate change effects. Earth surface forecasting represents one such task that integrates satellite images with meteorological data to capture th…

Earth Surface ForecastingSensitivity

SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognition

2023-03-06 · Naga VS Raviteja Chappa, Pha Nguyen, Alexander H Nelson, Han-Seok Seo 외

In this paper, we propose a new, simple, and effective Self-supervised Spatio-temporal Transformers (SPARTAN) approach to Group Activity Recognition (GAR) using unlabeled video data. Given a video, we create local and gl…

Activity RecognitionGroup Activity Recognition

Global Vegetation Modeling with Pre-Trained Weather Transformers

2024-03-27 · Pascal Janetzky, Florian Gallusser, Simon Hentschel, Andreas Hotho 외

Accurate vegetation models can produce further insights into the complex interaction between vegetation activity and ecosystem processes. Previous research has established that long-term trends and short-term variability…

Weather Forecasting

TerraTrace: Temporal Signature Land Use Mapping System

2025-02-25 · Angela Busheska, Vikram Iyer, Bruno Silva, Peder Olsen 외

Understanding land use over time is critical to tracking events related to climate change, like deforestation. However, satellite-based remote sensing tools which are used for monitoring struggle to differentiate vegetat…

Chatbot