paper-with-me

Papers

Ghost-free High Dynamic Range Imaging via Hybrid CNN-Transformer and Structure Tensor

2022-12-01 · Yu Yuan, Jiaqi Wu, Zhongliang Jing, Henry Leung, Han Pan

Eliminating ghosting artifacts due to moving objects is a challenging problem in high dynamic range (HDR) imaging. In this letter, we present a hybrid model consisting of a convolutional encoder and a Transformer decoder to generate ghost-free HDR images. In the encoder, a context aggregation network and non-local attention block are adopted to optimize multi-scale features and capture both global and local dependencies of multiple low dynamic range (LDR) images. The decoder based on Swin Transformer is utilized to improve the reconstruction capability of the proposed model. Motivated by the phenomenal difference between the presence and absence of artifacts under the field of structure tensor (ST), we integrate the ST information of LDR images as auxiliary inputs of the network and use ST loss to further constrain artifacts. Different from previous approaches, our network is capable of processing an arbitrary number of input LDR images. Qualitative and quantitative experiments demonstrate the effectiveness of the proposed method by comparing it with existing state-of-the-art HDR deghosting models. Codes are available at https://github.com/pandayuanyu/HSTHdr.

📄 PDF Abstract BibTeX arXiv:2212.00595

Code (1)

pandayuanyu/hsthdr 공식 구현 pytorch

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Ghost-free High Dynamic Range Imaging with Context-aware Transformer

2022-08-10 · Zhen Liu, Yinglong Wang, Bing Zeng, Shuaicheng Liu

High dynamic range (HDR) deghosting algorithms aim to generate ghost-free HDR images with realistic details. Restricted by the locality of the receptive field, existing CNN-based methods are typically prone to producing …

Vocal Bursts Intensity Prediction

IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imaging

2023-09-26 · Hailing Wang, Wei Li, Yuanyuan Xi, Jie Hu 외

Multi-frame high dynamic range (HDR) imaging aims to reconstruct ghost-free images with photo-realistic details from content-complementary but spatially misaligned low dynamic range (LDR) images. Existing HDR algorithms …

Attention-guided Network for Ghost-free High Dynamic Range Imaging

2019-04-23 · CVPR 2019 6 · Qingsen Yan, Dong Gong, Qinfeng Shi, Anton Van Den Hengel 외

Ghosting artifacts caused by moving objects or misalignments is a key challenge in high dynamic range (HDR) imaging for dynamic scenes. Previous methods first register the input low dynamic range (LDR) images using optic…

Optical Flow EstimationVocal Bursts Intensity Prediction

Scale-aware Two-stage High Dynamic Range Imaging

2023-03-12 · Hui Li, Xuyang Yao, Wuyuan Xie, Miaohui Wang

Deep high dynamic range (HDR) imaging as an image translation issue has achieved great performance without explicit optical flow alignment. However, challenges remain over content association ambiguities especially cause…

Optical Flow EstimationVocal Bursts Intensity PredictionVocal Bursts Valence Prediction

MIEHDR CNN: Main Image Enhancement based Ghost-Free High Dynamic Range Imaging using Dual-Lens Systems

2021-05-18 · AAAI Technical Track on Computer Vision I 2021 5 · Xuan Dong, Xiaoyan Hu, Weixin Li, Xiaojie Wang;Yunhong Wang

We study the High Dynamic Range (HDR) imaging problem using two Low Dynamic Range (LDR) images that are shot from dual-lens systems in a single shot time with different exposures. In most of the related HDR imaging metho…

DenoisingImage Enhancement