paper-with-me

홈 › Papers

CNN Injected Transformer for Image Exposure Correction

2023-09-08 · Shuning Xu, Xiangyu Chen, Binbin Song, Jiantao Zhou

Capturing images with incorrect exposure settings fails to deliver a satisfactory visual experience. Only when the exposure is properly set, can the color and details of the images be appropriately preserved. Previous exposure correction methods based on convolutions often produce exposure deviation in images as a consequence of the restricted receptive field of convolutional kernels. This issue arises because convolutions are not capable of capturing long-range dependencies in images accurately. To overcome this challenge, we can apply the Transformer to address the exposure correction problem, leveraging its capability in modeling long-range dependencies to capture global representation. However, solely relying on the window-based Transformer leads to visually disturbing blocking artifacts due to the application of self-attention in small patches. In this paper, we propose a CNN Injected Transformer (CIT) to harness the individual strengths of CNN and Transformer simultaneously. Specifically, we construct the CIT by utilizing a window-based Transformer to exploit the long-range interactions among different regions in the entire image. Within each CIT block, we incorporate a channel attention block (CAB) and a half-instance normalization block (HINB) to assist the window-based self-attention to acquire the global statistics and refine local features. In addition to the hybrid architecture design for exposure correction, we apply a set of carefully formulated loss functions to improve the spatial coherence and rectify potential color deviations. Extensive experiments demonstrate that our image exposure correction method outperforms state-of-the-art approaches in terms of both quantitative and qualitative metrics.

📄 PDF Abstract BibTeX arXiv:2309.04366

Code (1)

rebeccaeexu/cit-ec 공식 구현 pytorch

Tasks

BlockingExposure Correction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction

2022-05-30 · Ziteng Cui, Kunchang Li, Lin Gu, Shenghan Su 외

Challenging illumination conditions (low-light, under-exposure and over-exposure) in the real world not only cast an unpleasant visual appearance but also taint the computer vision tasks. After camera captures the raw-RG…

Exposure CorrectionImage EnhancementLow-Light Image Enhancementobject-detection+2

Holistic Dynamic Frequency Transformer for Image Fusion and Exposure Correction

2023-09-03 · Xiaoke Shang, Gehui Li, Zhiying Jiang, Shaomin Zhang 외

The correction of exposure-related issues is a pivotal component in enhancing the quality of images, offering substantial implications for various computer vision tasks. Historically, most methodologies have predominantl…

BenchmarkingExposure CorrectionImage Restoration

Unified-EGformer: Exposure Guided Lightweight Transformer for Mixed-Exposure Image Enhancement

2024-07-18 · Eashan Adhikarla, Kai Zhang, Rosaura G. VidalMata, Manjushree Aithal 외

Despite recent strides made by AI in image processing, the issue of mixed exposure, pivotal in many real-world scenarios like surveillance and photography, remains inadequately addressed. Traditional image enhancement te…

Autonomous NavigationImage Enhancement

Dual Illumination Estimation for Robust Exposure Correction

2019-10-30 · Qing Zhang, Yongwei Nie, Wei-Shi Zheng

Exposure correction is one of the fundamental tasks in image processing and computational photography. While various methods have been proposed, they either fail to produce visually pleasing results, or only work well fo…

Exposure CorrectionMulti-Exposure Image Fusion

Fearless Luminance Adaptation: A Macro-Micro-Hierarchical Transformer for Exposure Correction

2023-09-02 · Gehui Li, JinYuan Liu, Long Ma, Zhiying Jiang 외

Photographs taken with less-than-ideal exposure settings often display poor visual quality. Since the correction procedures vary significantly, it is difficult for a single neural network to handle all exposure problems.…

Exposure CorrectionFace RecognitionSemantic Segmentation