Cross-sensor super-resolution of irregularly sampled Sentinel-2 time series
Satellite imaging generally presents a trade-off between the frequency of acquisitions and the spatial resolution of the images. Super-resolution is often advanced as a way to get the best of both worlds. In this work, we investigate multi-image super-resolution of satellite image time series, i.e. how multiple images of the same area acquired at different dates can help reconstruct a higher resolution observation. In particular, we extend state-of-the-art deep single and multi-image super-resolution algorithms, such as SRDiff and HighRes-net, to deal with irregularly sampled Sentinel-2 time series. We introduce BreizhSR, a new dataset for 4x super-resolution of Sentinel-2 time series using very high-resolution SPOT-6 imagery of Brittany, a French region. We show that using multiple images significantly improves super-resolution performance, and that a well-designed temporal positional encoding allows us to perform super-resolution for different times of the series. In addition, we observe a trade-off between spectral fidelity and perceptual quality of the reconstructed HR images, questioning future directions for super-resolution of Earth Observation data.
Code (1)
Tasks
Earth ObservationImage Super-ResolutionSuper-ResolutionTime SeriesSimilar Papers 제목 키워드 기반
Graph-Guided Network for Irregularly Sampled Multivariate Time Series
In many domains, including healthcare, biology, and climate science, time series are irregularly sampled with varying time intervals between successive readouts and different subsets of variables (sensors) observed at di…
Graph Neural NetworkTime SeriesTime Series AnalysisLearning from Irregularly Sampled Data for Endomicroscopy Super-resolution: A Comparative Study of Sparse and Dense Approaches
Purpose: Probe-based Confocal Laser Endomicroscopy (pCLE) enables performing an optical biopsy, providing real-time microscopic images, via a probe. pCLE probes consist of multiple optical fibres arranged in a bundle, wh…
Image Quality AssessmentImage ReconstructionregressionSuper-ResolutionLocally-adapted convolution-based super-resolution of irregularly-sampled ocean remote sensing data
Super-resolution is a classical problem in image processing, with numerous applications to remote sensing image enhancement. Here, we address the super-resolution of irregularly-sampled remote sensing images. Using an op…
Image EnhancementSuper-ResolutionNo Imputation Needed: A Switch Approach to Irregularly Sampled Time Series
Modeling irregularly-sampled time series (ISTS) is challenging because of missing values. Most existing methods focus on handling ISTS by converting irregularly sampled data into regularly sampled data via imputation. Th…
ImputationMissing ValuesTime SeriesInterpolation-Prediction Networks for Irregularly Sampled Time Series
In this paper, we present a new deep learning architecture for addressing the problem of supervised learning with sparse and irregularly sampled multivariate time series. The architecture is based on the use of a semi-pa…
Deep LearningLength-of-Stay predictionMortality PredictionPrediction+3