paper-with-me

홈 › Papers

Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restoration

2025-01-27 · Long Peng, Xin Di, Zhanfeng Feng, Wenbo Li, Renjing Pei, Yang Wang, Xueyang Fu, Yang Cao, Zheng-Jun Zha

Image restoration aims to recover details and enhance contrast in degraded images. With the growing demand for high-quality imaging (\textit{e.g.}, 4K and 8K), achieving a balance between restoration quality and computational efficiency has become increasingly critical. Existing methods, primarily based on CNNs, Transformers, or their hybrid approaches, apply uniform deep representation extraction across the image. However, these methods often struggle to effectively model long-range dependencies and largely overlook the spatial characteristics of image degradation (regions with richer textures tend to suffer more severe damage), making it hard to achieve the best trade-off between restoration quality and efficiency. To address these issues, we propose a novel texture-aware image restoration method, TAMambaIR, which simultaneously perceives image textures and achieves a trade-off between performance and efficiency. Specifically, we introduce a novel Texture-Aware State Space Model, which enhances texture awareness and improves efficiency by modulating the transition matrix of the state-space equation and focusing on regions with complex textures. Additionally, we design a {Multi-Directional Perception Block} to improve multi-directional receptive fields while maintaining low computational overhead. Extensive experiments on benchmarks for image super-resolution, deraining, and low-light image enhancement demonstrate that TAMambaIR achieves state-of-the-art performance with significantly improved efficiency, establishing it as a robust and efficient framework for image restoration.

📄 PDF Abstract BibTeX arXiv:2501.16583

Code (0)

등록된 구현이 없습니다.

Tasks

4k8kComputational EfficiencyImage EnhancementImage RestorationImage Super-ResolutionLow-Light Image EnhancementMambaRain RemovalSuper-Resolution

Similar Papers 제목 키워드 기반

MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attention

2026-03-02 · Zilong Zhao, Zhengming Ding, Pei Niu, Wenhao Sun 외 arxiv

Feature encoders play a key role in pixel-level crack segmentation by shaping the representation of fine textures and thin structures. Existing CNN-, Transformer-, and Mamba-based models each capture only part of the req…

Crack Segmentation

AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes

2023-12-11 · Rao Fu, Zehao Wen, Zichen Liu, Srinath Sridhar

Inspired by cognitive theories, we introduce AnyHome, a framework that translates any text into well-structured and textured indoor scenes at a house-scale. By prompting Large Language Models (LLMs) with designed templat…

Diversity

DPMambaIR:All-in-One Image Restoration via Degradation-Aware Prompt State Space Model

2025-04-24 · Zhanwen Liu, Sai Zhou, Yuchao Dai, Yang Wang 외

All-in-One image restoration aims to address multiple image degradation problems using a single model, significantly reducing training costs and deployment complexity compared to traditional methods that design dedicated…

Image RestorationSSIM

Blind Image Super-resolution with Rich Texture-Aware Codebooks

2023-10-26 · Rui Qin, Ming Sun, Fangyuan Zhang, Xing Wen 외

Blind super-resolution (BSR) methods based on high-resolution (HR) reconstruction codebooks have achieved promising results in recent years. However, we find that a codebook based on HR reconstruction may not effectively…

Blind Super-ResolutionDiversityImage Super-ResolutionSuper-Resolution

Deep Texture and Structure Aware Filtering Network for Image Smoothing

2017-12-07 · ECCV 2018 9 · Kaiyue Lu, ShaoDi You, Nick Barnes

Image smoothing is a fundamental task in computer vision, that aims to retain salient structures and remove insignificant textures. In this paper, we aim to address the fundamental shortcomings of existing image smoothin…

image smoothing