paper-with-me

홈 › Papers

MambaIR: A Simple Baseline for Image Restoration with State-Space Model

2024-02-23 · Hang Guo, Jinmin Li, Tao Dai, Zhihao Ouyang, Xudong Ren, Shu-Tao Xia

Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma between global receptive fields and efficient computation, hindering their application in practice. Recently, the Selective Structured State Space Model, especially the improved version Mamba, has shown great potential for long-range dependency modeling with linear complexity, which offers a way to resolve the above dilemma. However, the standard Mamba still faces certain challenges in low-level vision such as local pixel forgetting and channel redundancy. In this work, we introduce a simple but effective baseline, named MambaIR, which introduces both local enhancement and channel attention to improve the vanilla Mamba. In this way, our MambaIR takes advantage of the local pixel similarity and reduces the channel redundancy. Extensive experiments demonstrate the superiority of our method, for example, MambaIR outperforms SwinIR by up to 0.45dB on image SR, using similar computational cost but with a global receptive field. Code is available at \url{https://github.com/csguoh/MambaIR}.

📄 PDF Abstract BibTeX arXiv:2402.15648

Code (2)

csguoh/mambair 공식 구현 pytorch
iridescentttt/SynQT pytorch

Tasks

Image RestorationImage Super-ResolutionMamba

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

MambaIRv2: Attentive State Space Restoration

2024-11-22 · CVPR 2025 1 · Hang Guo, Yong Guo, Yaohua Zha, Yulun Zhang 외

The Mamba-based image restoration backbones have recently demonstrated significant potential in balancing global reception and computational efficiency. However, the inherent causal modeling limitation of Mamba, where ea…

Computational EfficiencyImage RestorationMamba

DPMambaIR:All-in-One Image Restoration via Degradation-Aware Prompt State Space Model

2025-04-24 · Zhanwen Liu, Sai Zhou, Yuchao Dai, Yang Wang 외

All-in-One image restoration aims to address multiple image degradation problems using a single model, significantly reducing training costs and deployment complexity compared to traditional methods that design dedicated…

Image RestorationSSIM

VmambaIR: Visual State Space Model for Image Restoration

2024-03-18 · Yuan Shi, Bin Xia, Xiaoyu Jin, Xing Wang 외

Image restoration is a critical task in low-level computer vision, aiming to restore high-quality images from degraded inputs. Various models, such as convolutional neural networks (CNNs), generative adversarial networks…

DenoisingImage RestorationImage Super-Resolutionmodel+3

Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restoration

2025-01-27 · Long Peng, Xin Di, Zhanfeng Feng, Wenbo Li 외

Image restoration aims to recover details and enhance contrast in degraded images. With the growing demand for high-quality imaging (\textit{e.g.}, 4K and 8K), achieving a balance between restoration quality and computat…

4k8kComputational EfficiencyImage Enhancement+6

Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration

2025-03-27 · Yujie Chen, Haotong Qin, Zhang Zhang, Michelo Magno 외

State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length while effectively capturing long-distance dependencies. However, deploying …

Computational EfficiencyImage RestorationMambaModel Compression+2