Spatiotemporal Transformer for Imputing Sparse Data: A Deep Learning Approach
Effective management of environmental resources and agricultural sustainability heavily depends on accurate soil moisture data. However, datasets like the SMAP/Sentinel-1 soil moisture product often contain missing values across their spatiotemporal grid, which poses a significant challenge. This paper introduces a novel Spatiotemporal Transformer model (ST-Transformer) specifically designed to address the issue of missing values in sparse spatiotemporal datasets, particularly focusing on soil moisture data. The ST-Transformer employs multiple spatiotemporal attention layers to capture the complex spatiotemporal correlations in the data and can integrate additional spatiotemporal covariates during the imputation process, thereby enhancing its accuracy. The model is trained using a self-supervised approach, enabling it to autonomously predict missing values from observed data points. Our model's efficacy is demonstrated through its application to the SMAP 1km soil moisture data over a 36 x 36 km grid in Texas. It showcases superior accuracy compared to well-known imputation methods. Additionally, our simulation studies on other datasets highlight the model's broader applicability in various spatiotemporal imputation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningImputationManagementMissing ValuesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Causality-Aware Spatiotemporal Graph Neural Networks for Spatiotemporal Time Series Imputation
Spatiotemporal time series are usually collected via monitoring sensors placed at different locations, which usually contain missing values due to various failures, such as mechanical damages and Internet outages. Imputi…
Graph Neural NetworkImputationMissing ValuesTime SeriesSSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation
In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Spars…
Inductive BiasMotion SegmentationObjectOne-shot visual object segmentation+6A Probabilistic Framework for Imputing Genetic Distances in Spatiotemporal Pathogen Models
Pathogen genome data offers valuable structure for spatial models, but its utility is limited by incomplete sequencing coverage. We propose a probabilistic framework for inferring genetic distances between unsequenced ca…
ImputationTable Transformers for Imputing Textual Attributes
Missing data in tabular dataset is a common issue as the performance of downstream tasks usually depends on the completeness of the training dataset. Previous missing data imputation methods focus on numeric and categori…
ImputationMulti-Task LearningKriformer: A Novel Spatiotemporal Kriging Approach Based on Graph Transformers
Accurately estimating data in sensor-less areas is crucial for understanding system dynamics, such as traffic state estimation and environmental monitoring. This study addresses challenges posed by sparse sensor deployme…
Representation LearningState Estimation