paper-with-me

홈 › Papers

Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Models

2023-03-23 · CVPR 2023 1 · Cheng Guo, Leidong Fan, Ziyu Xue, and Xiuhua Jiang

In media industry, the demand of SDR-to-HDRTV up-conversion arises when users possess HDR-WCG (high dynamic range-wide color gamut) TVs while most off-the-shelf footage is still in SDR (standard dynamic range). The research community has started tackling this low-level vision task by learning-based approaches. When applied to real SDR, yet, current methods tend to produce dim and desaturated result, making nearly no improvement on viewing experience. Different from other network-oriented methods, we attribute such deficiency to training set (HDR-SDR pair). Consequently, we propose new HDRTV dataset (dubbed HDRTV4K) and new HDR-to-SDR degradation models. Then, it's used to train a luminance-segmented network (LSN) consisting of a global mapping trunk, and two Transformer branches on bright and dark luminance range. We also update assessment criteria by tailored metrics and subjective experiment. Finally, ablation studies are conducted to prove the effectiveness. Our work is available at: https://github.com/AndreGuo/HDRTVDM.

📄 PDF Abstract BibTeX arXiv:2303.13031

Code (1)

andreguo/hdrtvdm 공식 구현 pytorch

Tasks

AttributeInverse-Tone-Mapping

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Dual Inverse Degradation Network for Real-World SDRTV-to-HDRTV Conversion

2023-07-07 · Kepeng Xu, Li Xu, Gang He, Xianyun Wu 외

In this study, we address the emerging necessity of converting Standard Dynamic Range Television (SDRTV) content into High Dynamic Range Television (HDRTV) in light of the limited number of native HDRTV content. A princi…

inverse tone mappingInverse-Tone-MappingTone MappingVideo Restoration

Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

2024-11-16 · Kepeng Xu, Li Xu, Gang He, Zhiqiang Zhang 외

The rise of HDR-WCG display devices has highlighted the need to convert SDRTV to HDRTV, as most video sources are still in SDR. Existing methods primarily focus on designing neural networks to learn a single-style mappin…

Generative Adversarial Network

SDRTV-to-HDRTV Conversion via Spatial-Temporal Feature Fusion

2022-11-04 · Kepeng Xu, Li Xu, Gang He, Chang Wu 외

HDR(High Dynamic Range) video can reproduce realistic scenes more realistically, with a wider gamut and broader brightness range. HDR video resources are still scarce, and most videos are still stored in SDR (Standard Dy…

Towards Real World HDRTV Reconstruction: A Data Synthesis-based Approach

2022-11-06 · Zhen Cheng, Tao Wang, Yong Li, Fenglong Song 외

Existing deep learning based HDRTV reconstruction methods assume one kind of tone mapping operators (TMOs) as the degradation procedure to synthesize SDRTV-HDRTV pairs for supervised training. In this paper, we argue tha…

Tone Mapping

A New Journey from SDRTV to HDRTV

2021-08-18 · ICCV 2021 10 · Xiangyu Chen, Zhengwen Zhang, Jimmy S. Ren, Lynhoo Tian 외

Nowadays modern displays are capable to render video content with high dynamic range (HDR) and wide color gamut (WCG). However, most available resources are still in standard dynamic range (SDR). Therefore, there is an u…

Inverse-Tone-Mapping