paper-with-me

홈 › Papers

You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction

2022-05-30 · Ziteng Cui, Kunchang Li, Lin Gu, Shenghan Su, Peng Gao, Zhengkai Jiang, Yu Qiao, Tatsuya Harada

Challenging illumination conditions (low-light, under-exposure and over-exposure) in the real world not only cast an unpleasant visual appearance but also taint the computer vision tasks. After camera captures the raw-RGB data, it renders standard sRGB images with image signal processor (ISP). By decomposing ISP pipeline into local and global image components, we propose a lightweight fast Illumination Adaptive Transformer (IAT) to restore the normal lit sRGB image from either low-light or under/over-exposure conditions. Specifically, IAT uses attention queries to represent and adjust the ISP-related parameters such as colour correction, gamma correction. With only ~90k parameters and ~0.004s processing speed, our IAT consistently achieves superior performance over SOTA on the current benchmark low-light enhancement and exposure correction datasets. Competitive experimental performance also demonstrates that our IAT significantly enhances object detection and semantic segmentation tasks under various light conditions. Training code and pretrained model is available at https://github.com/cuiziteng/Illumination-Adaptive-Transformer.

📄 PDF Abstract BibTeX arXiv:2205.14871

Code (1)

cuiziteng/illumination-adaptive-transformer 공식 구현 pytorch

Tasks

Exposure CorrectionImage EnhancementLow-Light Image Enhancementobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer

2022-12-06 · Shibo Jie, Zhi-Hong Deng

Recent work has explored the potential to adapt a pre-trained vision transformer (ViT) by updating only a few parameters so as to improve storage efficiency, called parameter-efficient transfer learning (PETL). Current P…

8kTransfer Learning

Fast Context Adaptation via Meta-Learning

2018-10-08 · Luisa M. Zintgraf, Kyriacos Shiarlis, Vitaly Kurin, Katja Hofmann 외

We propose CAVIA for meta-learning, a simple extension to MAML that is less prone to meta-overfitting, easier to parallelise, and more interpretable. CAVIA partitions the model parameters into two parts: context paramete…

General ClassificationMeta-Learningregressionreinforcement-learning+2

Neural Moving Horizon Estimation for Robust Flight Control

2022-06-21 · Bingheng Wang, Zhengtian Ma, Shupeng Lai, Lin Zhao

Estimating and reacting to external disturbances is crucial for robust flight control of quadrotors. Existing estimators typically require significant tuning for a specific flight scenario or training with extensive grou…

Real-Time Fully Unsupervised Domain Adaptation for Lane Detection in Autonomous Driving

2023-06-29 · Kshitij Bhardwaj, Zishen Wan, Arijit Raychowdhury, Ryan Goldhahn

While deep neural networks are being utilized heavily for autonomous driving, they need to be adapted to new unseen environmental conditions for which they were not trained. We focus on a safety critical application of l…

Autonomous DrivingAvgDomain AdaptationLane Detection+1

SAR ATR under Limited Training Data Via MobileNetV3

2023-06-27 · Chenwei Wang, Siyi Luo, Lin Liu, Yin Zhang 외

In recent years, deep learning has been widely used to solve the bottleneck problem of synthetic aperture radar (SAR) automatic target recognition (ATR). However, most current methods rely heavily on a large number of tr…