RBSRICNN: Raw Burst Super-Resolution through Iterative Convolutional Neural Network
Modern digital cameras and smartphones mostly rely on image signal processing (ISP) pipelines to produce realistic colored RGB images. However, compared to DSLR cameras, low-quality images are usually obtained in many portable mobile devices with compact camera sensors due to their physical limitations. The low-quality images have multiple degradations i.e., sub-pixel shift due to camera motion, mosaick patterns due to camera color filter array, low-resolution due to smaller camera sensors, and the rest information are corrupted by the noise. Such degradations limit the performance of current Single Image Super-resolution (SISR) methods in recovering high-resolution (HR) image details from a single low-resolution (LR) image. In this work, we propose a Raw Burst Super-Resolution Iterative Convolutional Neural Network (RBSRICNN) that follows the burst photography pipeline as a whole by a forward (physical) model. The proposed Burst SR scheme solves the problem with classical image regularization, convex optimization, and deep learning techniques, compared to existing black-box data-driven methods. The proposed network produces the final output by an iterative refinement of the intermediate SR estimates. We demonstrate the effectiveness of our proposed approach in quantitative and qualitative experiments that generalize robustly to real LR burst inputs with onl synthetic burst data available for training.
Code (1)
Tasks
Image Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results
This paper reviews the NTIRE2021 challenge on burst super-resolution. Given a RAW noisy burst as input, the task in the challenge was to generate a clean RGB image with 4 times higher resolution. The challenge contained …
Super-ResolutionSelf-Supervised Burst Super-Resolution
We introduce a self-supervised training strategy for burst super-resolution that only uses noisy low-resolution bursts during training. Our approach eliminates the need to carefully tune synthetic data simulation pip…
Super-ResolutionSimple Base Frame Guided Residual Network for RAW Burst Image Super-Resolution
Burst super-resolution or multi-frame super-resolution (MFSR) has gained significant attention in recent years, particularly in the context of mobile photography. With modern handheld devices consistently increasing thei…
Burst Image Super-ResolutionImage Super-ResolutionMulti-Frame Super-ResolutionSuper-ResolutionBSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignment
This work addresses the Burst Super-Resolution (BurstSR) task using a new architecture, which requires restoring a high-quality image from a sequence of noisy, misaligned, and low-resolution RAW bursts. To overcome the c…
Burst Image ReconstructionBurst Image Super-ResolutionMulti-Frame Super-ResolutionOptical Flow Estimation+1Burst Image Super-Resolution with Base Frame Selection
Burst image super-resolution has been a topic of active research in recent years due to its ability to obtain a high-resolution image by using complementary information between multiple frames in the burst. In this work,…
Burst Image Super-ResolutionImage Super-ResolutionSuper-Resolution