paper-with-me

홈 › Papers

Towards Context-aware Convolutional Network for Image Restoration

2024-12-15 · Fangwei Hao, Ji Du, Weiyun Liang, Jing Xu, Xiaoxuan Xu

Image restoration (IR) is a long-standing task to recover a high-quality image from its corrupted observation. Recently, transformer-based algorithms and some attention-based convolutional neural networks (CNNs) have presented promising results on several IR tasks. However, existing convolutional residual building modules for IR encounter limited ability to map inputs into high-dimensional and non-linear feature spaces, and their local receptive fields have difficulty in capturing long-range context information like Transformer. Besides, CNN-based attention modules for IR either face static abundant parameters or have limited receptive fields. To address the first issue, we propose an efficient residual star module (ERSM) that includes context-aware "star operation" (element-wise multiplication) to contextually map features into exceedingly high-dimensional and non-linear feature spaces, which greatly enhances representation learning. To further boost the extraction of contextual information, as for the second issue, we propose a large dynamic integration module (LDIM) which possesses an extremely large receptive field. Thus, LDIM can dynamically and efficiently integrate more contextual information that helps to further significantly improve the reconstruction performance. Integrating ERSM and LDIM into an U-shaped backbone, we propose a context-aware convolutional network (CCNet) with powerful learning ability for contextual high-dimensional mapping and abundant contextual information. Extensive experiments show that our CCNet with low model complexity achieves superior performance compared to other state-of-the-art IR methods on several IR tasks, including image dehazing, image motion deblurring, and image desnowing.

📄 PDF Abstract BibTeX arXiv:2412.11008

Code (0)

등록된 구현이 없습니다.

Tasks

DeblurringImage DehazingImage RestorationRepresentation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
CCNet Criss-Cross Network (CCNet) aims to obtain full-image contextual information in an effective and efficient way. Concretely, for each pixel, a novel criss-cross attention…

Similar Papers 제목 키워드 기반

CascadedGaze: Efficiency in Global Context Extraction for Image Restoration

2024-01-26 · Amirhosein Ghasemabadi, Muhammad Kamran Janjua, Mohammad Salameh, Chunhua Zhou 외

Image restoration tasks traditionally rely on convolutional neural networks. However, given the local nature of the convolutional operator, they struggle to capture global information. The promise of attention mechanisms…

DeblurringDecoderDenoisingImage Deblurring+3

SnowFormer: Context Interaction Transformer with Scale-awareness for Single Image Desnowing

2022-08-20 · Sixiang Chen, Tian Ye, Yun Liu, ErKang Chen

Due to various and complicated snow degradations, single image desnowing is a challenging image restoration task. As prior arts can not handle it ideally, we propose a novel transformer, SnowFormer, which explores effici…

Image RestorationSingle Image DesnowingSnow Removal

Dilated Strip Attention Network for Image Restoration

2024-07-26 · Fangwei Hao, Jiesheng Wu, Ji Du, Yinjie Wang 외

Image restoration is a long-standing task that seeks to recover the latent sharp image from its deteriorated counterpart. Due to the robust capacity of self-attention to capture long-range dependencies, transformer-based…

Image RestorationRepresentation Learning

Context-Aware Pretraining for Efficient Blind Image Decomposition

2023-01-01 · CVPR 2023 1 · Chao Wang, Zhedong Zheng, Ruijie Quan, Yifan Sun 외

In this paper, we study Blind Image Decomposition (BID), which is to uniformly remove multiple types of degradation at once without foreknowing the noise type. There remain two practical challenges: (1) Existing meth…

AttributeImage ReconstructionImage Restoration

IRNeXt: Rethinking Convolutional Network Design for Image Restoration

2023-04-24 · ICML 2023 4 · Yuning Cui, Wenqi Ren, Sining Yang, Xiaochun Cao 외

We present IRNeXt, a simple yet effective convolutional network architecture for image restoration. Recently, Transformer models have dominated the field of image restoration due to the powerful ability of modeling long-…

DeblurringImage DeblurringImage DehazingImage Restoration+1