Deep Interleaved Network for Image Super-Resolution With Asymmetric Co-Attention
Recently, Convolutional Neural Networks (CNN) based image super-resolution (SR) have shown significant success in the literature. However, these methods are implemented as single-path stream to enrich feature maps from the input for the final prediction, which fail to fully incorporate former low-level features into later high-level features. In this paper, to tackle this problem, we propose a deep interleaved network (DIN) to learn how information at different states should be combined for image SR where shallow information guides deep representative features prediction. Our DIN follows a multi-branch pattern allowing multiple interconnected branches to interleave and fuse at different states. Besides, the asymmetric co-attention (AsyCA) is proposed and attacked to the interleaved nodes to adaptively emphasize informative features from different states and improve the discriminative ability of networks. Extensive experiments demonstrate the superiority of our proposed DIN in comparison with the state-of-the-art SR methods.
Code (1)
Tasks
Image Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
Learning Deep Interleaved Networks with Asymmetric Co-Attention for Image Restoration
Recently, convolutional neural network (CNN) has demonstrated significant success for image restoration (IR) tasks (e.g., image super-resolution, image deblurring, rain streak removal, and dehazing). However, existing CN…
DeblurringImage DeblurringImage RestorationImage Super-Resolution+1ARMOR v0.1: Empowering Autoregressive Multimodal Understanding Model with Interleaved Multimodal Generation via Asymmetric Synergy
Unified models (UniMs) for multimodal understanding and generation have recently received much attention in the area of vision and language. Existing UniMs are designed to simultaneously learn both multimodal understandi…
DecoderImage Generationmultimodal generationMambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs
We present MambaCSR, a simple but effective framework based on Mamba for the challenging compressed image super-resolution (CSR) task. Particularly, the scanning strategies of Mamba are crucial for effective contextual k…
Compressed Image Super-resolutionImage Super-ResolutionMambaSuper-ResolutionCorrespondence Transformers With Asymmetric Feature Learning and Matching Flow Super-Resolution
This paper solves the problem of learning dense visual correspondences between different object instances of the same category with only sparse annotations. We decompose this pixel-level semantic matching problem int…
Super-ResolutionSTRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning
Fetal motion is unpredictable and rapid on the scale of conventional MR scan times. Therefore, dynamic fetal MRI, which aims at capturing fetal motion and dynamics of fetal function, is limited to fast imaging techniques…
Self-Supervised LearningSuper-ResolutionTime Series Analysis