paper-with-me

홈 › Papers

Modeling the Lighting in Scenes as Style for Auto White-Balance Correction

2022-10-17 · Furkan Kınlı, Doğa Yılmaz, Barış Özcan, Furkan Kıraç

Style may refer to different concepts (e.g. painting style, hairstyle, texture, color, filter, etc.) depending on how the feature space is formed. In this work, we propose a novel idea of interpreting the lighting in the single- and multi-illuminant scenes as the concept of style. To verify this idea, we introduce an enhanced auto white-balance (AWB) method that models the lighting in single- and mixed-illuminant scenes as the style factor. Our AWB method does not require any illumination estimation step, yet contains a network learning to generate the weighting maps of the images with different WB settings. Proposed network utilizes the style information, extracted from the scene by a multi-head style extraction module. AWB correction is completed after blending these weighting maps and the scene. Experiments on single- and mixed-illuminant datasets demonstrate that our proposed method achieves promising correction results when compared to the recent works. This shows that the lighting in the scenes with multiple illuminations can be modeled by the concept of style. Source code and trained models are available on https://github.com/birdortyedi/lighting-as-style-awb-correction.

📄 PDF Abstract BibTeX arXiv:2210.09090

Code (1)

birdortyedi/lighting-as-style-awb-correction 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Auto White-Balance Correction for Mixed-Illuminant Scenes

2021-09-17 · Mahmoud Afifi, Marcus A. Brubaker, Michael S. Brown

Auto white balance (AWB) is applied by camera hardware at capture time to remove the color cast caused by the scene illumination. The vast majority of white-balance algorithms assume a single light source illuminates the…

Template matching with white balance adjustment under multiple illuminants

2022-08-03 · Teruaki Akazawa, Yuma Kinoshita, Hitoshi Kiya

In this paper, we propose a novel template matching method with a white balancing adjustment, called N-white balancing, which was proposed for multi-illuminant scenes. To reduce the influence of lighting effects, N-white…

Color Constancyobject-detectionObject DetectionTemplate Matching

SILT: Self-supervised Lighting Transfer Using Implicit Image Decomposition

2021-10-25 · Nikolina Kubiak, Armin Mustafa, Graeme Phillipson, Stephen Jolly 외

We present SILT, a Self-supervised Implicit Lighting Transfer method. Unlike previous research on scene relighting, we do not seek to apply arbitrary new lighting configurations to a given scene. Instead, we wish to tran…

DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality

2019-04-02 · CVPR 2019 6 · Chloe LeGendre, Wan-Chun Ma, Graham Fyffe, John Flynn 외

We present a learning-based method to infer plausible high dynamic range (HDR), omnidirectional illumination given an unconstrained, low dynamic range (LDR) image from a mobile phone camera with a limited field of view (…

Mixed Reality

A Dataset of Multi-Illumination Images in the Wild

2019-10-17 · ICCV 2019 10 · Lukas Murmann, Michael Gharbi, Miika Aittala, Fredo Durand

Collections of images under a single, uncontrolled illumination have enabled the rapid advancement of core computer vision tasks like classification, detection, and segmentation. But even with modern learning techniques,…

Image Relighting