Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellites
Modern Earth observation satellites capture multi-exposure bursts of push-frame images that can be super-resolved via computational means. In this work, we propose a super-resolution method for such multi-exposure sequences, a problem that has received very little attention in the literature. The proposed method can handle the signal-dependent noise in the inputs, process sequences of any length, and be robust to inaccuracies in the exposure times. Furthermore, it can be trained end-to-end with self-supervision, without requiring ground truth high resolution frames, which makes it especially suited to handle real data. Central to our method are three key contributions: i) a base-detail decomposition for handling errors in the exposure times, ii) a noise-level-aware feature encoding for improved fusion of frames with varying signal-to-noise ratio and iii) a permutation invariant fusion strategy by temporal pooling operators. We evaluate the proposed method on synthetic and real data and show that it outperforms by a significant margin existing single-exposure approaches that we adapted to the multi-exposure case.
Code (0)
등록된 구현이 없습니다.
Tasks
Earth ObservationSuper-ResolutionSimilar Papers 제목 키워드 기반
Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes
Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using…
HDR ReconstructionTransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning
In this paper, we propose TransMEF, a transformer-based multi-exposure image fusion framework that uses self-supervised multi-task learning. The framework is based on an encoder-decoder network, which can be trained on l…
DecoderMulti-Exposure Image FusionMulti-Task LearningSelf-supervised Learning of Event-guided Video Frame Interpolation for Rolling Shutter Frames
Most consumer cameras use rolling shutter (RS) exposure, which often leads to distortions such as skew and jelly effects. These videos are further limited by bandwidth and frame rate constraints. In this paper, we explor…
Self-Supervised LearningVideo Frame InterpolationLoopExpose: An Unsupervised Framework for Arbitrary-Length Exposure Correction
Exposure correction is essential for enhancing image quality under challenging lighting conditions. While supervised learning has achieved significant progress in this area, it relies heavily on large-scale labeled datas…
Self-Supervised Image Restoration with Blurry and Noisy Pairs
When taking photos under an environment with insufficient light, the exposure time and the sensor gain usually require to be carefully chosen to obtain images with satisfying visual quality. For example, the images with …
DeblurringDenoisingImage Restoration