Efficient Model Agnostic Approach for Implicit Neural Representation Based Arbitrary-Scale Image Super-Resolution
Single image super-resolution (SISR) has experienced significant advancements, primarily driven by deep convolutional networks. Traditional networks, however, are limited to upscaling images to a fixed scale, leading to the utilization of implicit neural functions for generating arbitrarily scaled images. Nevertheless, these methodologies have imposed substantial computational demands as they involve querying every target pixel to a single resource-intensive decoder. In this paper, we introduce a novel and efficient framework, the Mixture of Experts Implicit Super-Resolution (MoEISR), which enables super-resolution at arbitrary scales with significantly increased computational efficiency without sacrificing reconstruction quality. MoEISR dynamically allocates the most suitable decoding expert to each pixel using a lightweight mapper module, allowing experts with varying capacities to reconstruct pixels across regions with diverse complexities. Our experiments demonstrate that MoEISR successfully reduces up to 73% in floating point operations (FLOPs) while delivering comparable or superior peak signal-to-noise ratio (PSNR).
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDecoderImage Super-ResolutionMixture-of-ExpertsSuper-ResolutionSimilar Papers 제목 키워드 기반
Dynamic Implicit Image Function for Efficient Arbitrary-Scale Image Representation
Recent years have witnessed the remarkable success of implicit neural representation methods. The recent work Local Implicit Image Function (LIIF) has achieved satisfactory performance for continuous image representation…
Computational EfficiencySuper-ResolutionHyperspectral Image Fusion with Spectral-Band and Fusion-Scale Agnosticism
Current deep learning models for Multispectral and Hyperspectral Image Fusion (MS/HS fusion) are typically designed for fixed spectral bands and spatial scales, which limits their transferability across diverse sensors. …
Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding
Is the center position fully capable of representing a pixel? There is nothing wrong to represent pixels with their centers in a discrete image representation, but it makes more sense to consider each pixel as the aggreg…
Image Super-ResolutionSuper-ResolutionCascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution
Implicit neural representation has recently shown a promising ability in representing images with arbitrary resolutions. In this paper, we present a Local Implicit Transformer (LIT), which integrates the attention mechan…
Super-ResolutionLearning Dual-Level Deformable Implicit Representation for Real-World Scale Arbitrary Super-Resolution
Scale arbitrary super-resolution based on implicit image function gains increasing popularity since it can better represent the visual world in a continuous manner. However, existing scale arbitrary works are trained and…
Super-Resolution