Multi-Modality Image Super-Resolution using Generative Adversarial Networks
Over the past few years deep learning-based techniques such as Generative Adversarial Networks (GANs) have significantly improved solutions to image super-resolution and image-to-image translation problems. In this paper, we propose a solution to the joint problem of image super-resolution and multi-modality image-to-image translation. The problem can be stated as the recovery of a high-resolution image in a modality, given a low-resolution observation of the same image in an alternative modality. Our paper offers two models to address this problem and will be evaluated on the recovery of high-resolution day images given low-resolution night images of the same scene. Promising qualitative and quantitative results will be presented for each model.
Code (1)
Tasks
Image Super-ResolutionImage-to-Image TranslationSuper-ResolutionTranslationSimilar Papers 제목 키워드 기반
Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy
Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can prod…
The Power of Context: How Multimodality Improves Image Super-Resolution
Single-image super-resolution (SISR) remains challenging due to the inherent difficulty of recovering fine-grained details and preserving perceptual quality from low-resolution inputs. Existing methods often rely on limi…
Image Super-ResolutionSuper-ResolutionPGMAN: An Unsupervised Generative Multi-adversarial Network for Pan-sharpening
Pan-sharpening aims at fusing a low-resolution (LR) multi-spectral (MS) image and a high-resolution (HR) panchromatic (PAN) image acquired by a satellite to generate an HR MS image. Many deep learning based methods have …
Global and Local Mamba Network for Multi-Modality Medical Image Super-Resolution
Convolutional neural networks and Transformer have made significant progresses in multi-modality medical image super-resolution. However, these methods either have a fixed receptive field for local learning or significan…
Image Super-ResolutionMambaState Space ModelsSuper-ResolutionMultimodal Image Super-resolution via Deep Unfolding with Side Information
Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understa…
Image Super-ResolutionSuper-Resolution